-- Logs begin at Fri 2022-09-16 08:56:25 UTC, end at Fri 2022-09-16 10:15:40 UTC. -- Sep 16 09:41:26.503793 dv-cinder-790535-43-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 16 09:41:26.513199 dv-cinder-790535-43-iscsi devstack@n-api.service[112636]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 16 09:41:26.515338 dv-cinder-790535-43-iscsi devstack@n-api.service[112636]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 16 09:41:26 2022] *** Sep 16 09:41:26.515338 dv-cinder-790535-43-iscsi devstack@n-api.service[112636]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 16 09:41:26.515338 dv-cinder-790535-43-iscsi devstack@n-api.service[112636]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 16 09:41:26.515338 dv-cinder-790535-43-iscsi devstack@n-api.service[112636]: nodename: dv-cinder-790535-43-iscsi Sep 16 09:41:26.515338 dv-cinder-790535-43-iscsi devstack@n-api.service[112636]: machine: x86_64 Sep 16 09:41:26.515338 dv-cinder-790535-43-iscsi devstack@n-api.service[112636]: clock source: unix Sep 16 09:41:26.515338 dv-cinder-790535-43-iscsi devstack@n-api.service[112636]: pcre jit disabled Sep 16 09:41:26.515338 dv-cinder-790535-43-iscsi devstack@n-api.service[112636]: detected number of CPU cores: 4 Sep 16 09:41:26.515338 dv-cinder-790535-43-iscsi devstack@n-api.service[112636]: current working directory: / Sep 16 09:41:26.515338 dv-cinder-790535-43-iscsi devstack@n-api.service[112636]: detected binary path: /usr/bin/uwsgi-core Sep 16 09:41:26.515338 dv-cinder-790535-43-iscsi devstack@n-api.service[112636]: your processes number limit is 47680 Sep 16 09:41:26.515338 dv-cinder-790535-43-iscsi devstack@n-api.service[112636]: your memory page size is 4096 bytes Sep 16 09:41:26.516181 dv-cinder-790535-43-iscsi devstack@n-api.service[112636]: detected max file descriptor number: 2048 Sep 16 09:41:26.516181 dv-cinder-790535-43-iscsi devstack@n-api.service[112636]: lock engine: pthread robust mutexes Sep 16 09:41:26.516181 dv-cinder-790535-43-iscsi devstack@n-api.service[112636]: thunder lock: enabled Sep 16 09:41:26.516181 dv-cinder-790535-43-iscsi devstack@n-api.service[112636]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 16 09:41:26.516181 dv-cinder-790535-43-iscsi devstack@n-api.service[112636]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 16 09:41:26.555375 dv-cinder-790535-43-iscsi devstack@n-api.service[112636]: Python main interpreter initialized at 0x5638cea519c0 Sep 16 09:41:26.555375 dv-cinder-790535-43-iscsi devstack@n-api.service[112636]: python threads support enabled Sep 16 09:41:26.555375 dv-cinder-790535-43-iscsi devstack@n-api.service[112636]: your server socket listen backlog is limited to 100 connections Sep 16 09:41:26.555375 dv-cinder-790535-43-iscsi devstack@n-api.service[112636]: your mercy for graceful operations on workers is 90 seconds Sep 16 09:41:26.555725 dv-cinder-790535-43-iscsi devstack@n-api.service[112636]: mapped 403077 bytes (393 KB) for 2 cores Sep 16 09:41:26.555802 dv-cinder-790535-43-iscsi devstack@n-api.service[112636]: *** Operational MODE: preforking *** Sep 16 09:41:26.556032 dv-cinder-790535-43-iscsi devstack@n-api.service[112636]: *** uWSGI is running in multiple interpreter mode *** Sep 16 09:41:26.556032 dv-cinder-790535-43-iscsi devstack@n-api.service[112636]: spawned uWSGI master process (pid: 112636) Sep 16 09:41:26.556232 dv-cinder-790535-43-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 16 09:41:26.556777 dv-cinder-790535-43-iscsi devstack@n-api.service[112636]: spawned uWSGI worker 1 (pid: 112637, cores: 1) Sep 16 09:41:26.557783 dv-cinder-790535-43-iscsi devstack@n-api.service[112636]: spawned uWSGI worker 2 (pid: 112638, cores: 1) Sep 16 09:41:26.557783 dv-cinder-790535-43-iscsi devstack@n-api.service[112636]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 16 09:41:27.220896 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 16 09:41:27.225659 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 16 09:41:28.320312 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 09:41:28.320312 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: from cryptography.utils import int_from_bytes Sep 16 09:41:28.320951 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 09:41:28.320951 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: from cryptography.utils import int_from_bytes Sep 16 09:41:28.323751 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 09:41:28.323751 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: from cryptography.utils import int_from_bytes Sep 16 09:41:28.324175 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 09:41:28.324175 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: from cryptography.utils import int_from_bytes Sep 16 09:41:30.828258 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 16 09:41:30.828804 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 16 09:41:30.829033 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 16 09:41:30.829196 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 16 09:41:30.829575 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 16 09:41:30.829675 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 16 09:41:30.829766 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 16 09:41:30.830005 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 16 09:41:30.830095 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.830361 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.830448 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 16 09:41:30.830617 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 16 09:41:30.830711 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.830989 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.831080 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.831321 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.831420 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.831630 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.831714 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.831957 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.832055 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.832271 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.832370 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.832587 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.832698 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.832847 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.832941 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.833163 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.833250 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.833490 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-790535-43-iscsi {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.833620 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.833809 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.833894 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.834128 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.834214 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.834435 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.834520 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-790535-43-iscsi {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.834752 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.834847 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.835055 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.835143 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.835363 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.835454 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.835669 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.835760 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.835988 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.836169 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.836579 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.836714 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.836834 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.836948 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.837106 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.837230 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.837410 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.837521 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.837745 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.837835 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.838055 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.838147 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.838391 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.838477 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.838706 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.838795 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.839013 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.839106 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.839324 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.839417 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.839628 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.839715 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-790535-43-iscsi {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.839952 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.840038 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.840260 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.840350 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.840623 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.840750 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-790535-43-iscsi {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.840957 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.841049 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.841269 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.841374 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.841607 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.841726 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.841968 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.842102 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.842383 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.842540 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.842708 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.842800 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.843038 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.843149 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.843360 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.843483 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.843678 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.843794 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.843999 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.844124 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.844301 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.844449 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.844609 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.844772 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.844917 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.845095 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.845237 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.845399 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.845567 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.845734 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.845867 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.846060 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.846202 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.846372 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.846460 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.846679 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.846767 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.846987 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.847091 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.847241 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.847328 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.847550 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.847645 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.847812 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.847908 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.848131 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.848224 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.848453 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.848541 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.848733 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.848820 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.848984 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.849072 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.849305 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.849399 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.849649 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.849742 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.849953 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.850040 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.850259 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.850358 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.850562 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.850653 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.850865 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.850950 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.851169 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.851255 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.851475 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.851560 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.851780 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.851874 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.852086 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.852187 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.852402 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.852495 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.852713 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.852800 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.73 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.853035 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.853123 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.73 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.853341 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.853427 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.853681 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.853768 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.854024 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.854118 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.73 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.854320 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.73 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.854406 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.854626 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.854712 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.854945 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.855031 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.855250 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.855343 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.855555 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.855654 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.855860 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.856001 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.856180 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.856308 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.856484 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.856583 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.856788 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.856876 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.857038 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.857123 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.857337 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.857431 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.857662 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.857763 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.858005 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.858196 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.858311 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.858539 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.858706 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.858847 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.858934 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.859158 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.859257 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.859474 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.859565 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.859779 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.859871 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.860083 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.860178 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.860384 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.860469 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.860683 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.860774 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.860985 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.861077 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.861284 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.861370 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.861615 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.861717 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.861921 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.862016 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.862222 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.862307 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.862526 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.862611 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.862832 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.862933 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.863131 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.863223 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.863433 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.863529 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.863735 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.863828 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.864035 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.864126 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.864353 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.864438 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.864655 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.864749 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.864957 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.865043 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.865262 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.865348 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.865578 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.865680 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.865886 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.865973 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.866206 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.866300 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.866509 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.866597 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.866815 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.866904 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.867120 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.867213 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.867420 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.867507 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.867724 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.867810 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.868033 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.868125 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.868337 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.868423 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.868642 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.868727 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.868945 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.869031 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.869249 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.869375 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.869566 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.869657 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.869877 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.869962 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.870181 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.870364 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.870483 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.870569 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.870779 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.870877 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.871084 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.871170 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.871392 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.871479 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.871699 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.871794 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.872001 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.872090 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.872366 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.872463 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.872611 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.872710 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.872933 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.873018 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.873244 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.873330 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.874085 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.874223 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.874391 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.874480 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.875028 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.875154 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:41:30.875362 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.875496 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.875680 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.875836 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.875995 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.876187 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.876309 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.876515 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.876635 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.876857 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.876944 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.877195 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.877290 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.877515 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.877647 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.877855 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.877949 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.878172 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.878259 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.878499 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.878585 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.878812 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.878986 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.879124 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.879219 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.879439 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.879533 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.879746 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.879833 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.880064 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.880152 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.880394 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.880480 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.880710 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.880795 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.881017 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.881105 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.881335 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.881422 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.881676 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.881768 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.881998 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.882086 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.882331 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.882463 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.882652 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.882738 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.882963 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.883059 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.883273 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.883361 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.883584 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.883679 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.883927 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.884017 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.884238 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.884325 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.884550 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.884645 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.884863 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.884948 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.885173 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.885266 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.885483 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.885620 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.885824 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.885917 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.886137 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.886225 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.886450 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.886549 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.886762 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.886860 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.887072 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.887159 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.887400 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.887495 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.887712 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.887807 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.888019 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.888108 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.888332 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.888420 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.888641 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.888727 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.888949 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.889035 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.889826 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.890090 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.890178 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.890420 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.890540 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.890750 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.890846 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.891070 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.891157 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.891386 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.891473 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.891709 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.891803 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.892026 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.892120 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.892339 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.892427 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.892651 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.892746 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.892959 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.893046 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.893266 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.893360 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.893595 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.893689 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.893912 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.893998 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.894219 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.894305 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.894526 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.894619 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.894835 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.894928 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.895149 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.895236 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.895461 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.895549 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.895768 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.895855 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.896079 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.896173 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.896390 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.896485 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.896696 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.896782 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.897003 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.897098 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.897317 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.897403 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.897677 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.897770 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.897965 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.898065 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.898276 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.898369 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.898587 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.898674 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.898893 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.899023 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.899203 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.899289 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.899514 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.899607 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.899825 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.899958 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.900133 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.900218 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.900446 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.900532 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.900761 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.900849 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.901076 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.901161 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.901403 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.901503 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.901744 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.901834 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.902060 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.902152 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.902365 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.902458 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.902675 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.902763 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.902977 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.903070 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.903280 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.903446 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.903570 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.903665 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.903879 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.903967 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.904180 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.904275 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.904482 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.904577 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.904825 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.904916 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.905135 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.905235 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.905439 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.905526 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.905790 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.905880 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.906099 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.906198 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.906404 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.906498 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.906709 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.906797 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.907015 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.907102 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.907322 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.907408 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.907630 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.907716 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.907957 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.908045 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.908267 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.908353 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.908573 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.908659 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.908877 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.908965 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.909183 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.909269 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.909513 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.909663 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.909846 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.909934 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.910158 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.910250 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.910469 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.910564 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.910782 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.910870 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.911101 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.911187 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.911412 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.911511 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.911736 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.911824 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.912046 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.912133 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.912358 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.912452 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.912668 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.912789 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.912980 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.913072 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.913282 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.913376 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.913623 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.913758 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.913959 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.914055 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.914293 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.914389 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.914610 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.914704 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.914923 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.915009 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.915233 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.915319 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.915535 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.915620 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.915842 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.915928 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.916152 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.916240 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.916460 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.916548 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.916770 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.916857 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.917088 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.917184 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.917396 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.917483 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.917740 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.917830 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.918051 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.918144 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.918366 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.918453 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.918672 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.918766 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.918979 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.919065 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.919279 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.919372 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.919592 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.919686 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.919907 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.919994 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.920220 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.920307 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.920564 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.920674 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.920925 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.921014 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.921250 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.921360 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.921581 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.921687 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.921894 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.922004 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.922205 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.922336 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.922509 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.922677 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.922814 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.922992 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.923123 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.923309 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.923437 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.923633 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.923747 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.923947 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.924056 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.924257 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.924352 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.924570 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.924659 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.924879 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.924965 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.925185 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.925280 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.925498 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.925601 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.925841 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.925939 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.926154 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.926253 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.926462 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.926560 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.926772 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.926858 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.927087 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.927175 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.927389 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.927481 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.927692 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.927779 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.927998 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.928086 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.928308 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.928394 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.928613 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.928700 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.928917 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.929066 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.929220 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.929341 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.929587 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.929692 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.929877 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.929965 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.930177 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.930262 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.930492 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.930590 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.930801 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.930895 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.931106 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.931193 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.931414 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.931514 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.931720 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.931808 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.932027 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.932119 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.932350 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.932515 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.932656 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.932742 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.932962 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.933057 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.933272 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.933368 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.933601 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.933704 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.933914 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.934009 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.934223 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.934311 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.934533 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.934627 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.934838 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.934923 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.935146 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.935234 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.935453 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.935540 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.935755 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.935843 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.936595 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.936792 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.936912 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.937000 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.937345 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.937489 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.937741 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.937839 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.937969 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.938153 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.938285 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.938473 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.938597 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.938818 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.938914 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.939138 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.939227 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.939472 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.939563 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.939799 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.940065 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.940152 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.940402 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.940487 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.940711 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.940800 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.941016 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.941103 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.941320 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.941414 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.941665 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.941819 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.941960 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.942048 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.942269 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.942357 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.942572 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.942675 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.942880 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.942973 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.943182 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.943272 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.943482 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.943580 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.943782 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.943913 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.944085 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.944175 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.944388 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.944519 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.944688 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.944774 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.944992 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.945085 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.945294 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.945381 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.945623 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.945713 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.945933 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.946021 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.946233 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.946319 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.946536 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.946622 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.946836 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.946921 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.947153 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.947247 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.947468 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.947554 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.947774 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.947867 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.948102 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.948190 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.948411 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.948505 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.948717 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.948815 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.949022 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.949108 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.949328 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.949414 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.949656 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.949764 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.949965 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.950052 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.950269 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.950355 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.950613 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.950730 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.950886 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.950974 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.951186 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.951273 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.951494 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.951589 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.952375 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.952514 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.952682 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.952782 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.952995 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.953093 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.953295 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.953401 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.953627 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.953719 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.953933 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.954023 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.954239 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.954324 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.954544 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.954638 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.954847 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.954935 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.955148 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.955244 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.955458 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.955551 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.955762 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.955849 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.956064 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.956158 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.956367 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.956462 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.956667 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.956759 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.956979 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.957072 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.957278 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.957436 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.957601 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.957829 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.957902 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.957967 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.958199 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.958289 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.958505 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.958579 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.958805 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.958881 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.959107 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.959195 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.959424 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.959500 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.959724 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.959800 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.960027 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.960120 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.960330 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.960417 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.960632 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.960719 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.960937 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.961014 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.961240 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.961314 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.961585 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.961665 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.961890 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.961978 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.962190 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.962276 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.962492 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.962585 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.962793 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.962879 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.963096 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.963182 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.963416 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.963514 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.963703 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.963790 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.964005 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.964092 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.964318 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.964398 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.964593 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.964670 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.964893 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.964978 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.965194 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.965283 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.965517 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.965847 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.966152 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.966508 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.966758 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.967107 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.967289 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.967507 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.967662 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.967870 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.967994 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.968177 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.968266 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.968493 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.968590 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.968814 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.968911 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.969126 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.969224 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.969437 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.969524 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.969780 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.969882 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.970115 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.970193 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.970390 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.970474 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.970699 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.970789 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.971006 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.971083 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.971334 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.971420 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.971607 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.971692 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.971929 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.972006 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.972241 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.972318 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.972555 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.972639 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.972880 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.972956 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.973195 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.973282 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.973511 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.973622 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.973840 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.973926 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.974145 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.974231 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.974485 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.974579 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.974795 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.974882 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.975108 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.975215 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.975409 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.975497 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.975717 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.975802 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.976045 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.976147 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.976342 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.976428 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.976649 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.976734 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.976961 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.977056 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.977267 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.977362 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.977599 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.977740 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.977911 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.978009 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.978217 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.978313 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.978530 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.978616 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.978841 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.978936 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.979236 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.979343 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.979466 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.979553 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.979785 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.979965 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.980088 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.980181 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.980393 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.980491 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.980704 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.980869 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.981016 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.981184 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.981327 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.981501 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.981657 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.981832 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.981965 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.982146 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.982275 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.982463 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.982604 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.982779 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.982958 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.983223 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.983312 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.983573 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.983661 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.983878 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.984040 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.984192 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.984355 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.984501 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.984700 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.984938 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.985034 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.985423 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.985772 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.985877 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.985960 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.986039 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.986118 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.986197 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.986275 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.986485 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.986574 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.986791 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.986878 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.987096 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.987268 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.987402 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.987489 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.987715 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.987838 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.988039 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.988134 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.988438 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.988540 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.988752 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.988841 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.989054 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.989149 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.989379 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.989487 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.989692 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.989782 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.990023 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.990113 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.990333 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.990426 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.990645 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.990754 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.990950 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.991059 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.991280 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.991398 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.991585 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.991701 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.991911 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.992058 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.992235 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.992351 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.992567 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.992690 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.992880 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.993001 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.993193 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.993344 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.993499 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.993699 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.993856 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.993983 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.994185 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.994305 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.994502 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.994616 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.994827 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.994943 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.995226 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.995351 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.995546 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.995675 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.995855 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.995988 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.996178 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.996312 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.996503 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.996673 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.996805 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.996919 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.997111 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.997199 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.997421 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.997523 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.997745 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.997912 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.998051 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.998140 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.998378 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.998469 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.999360 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.999756 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:30.999920 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.000011 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.000236 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.000324 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.000548 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.000643 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.000855 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.000949 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.001169 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.001277 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.001490 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.001686 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.001827 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.001956 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.002155 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.002280 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.002471 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.002595 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.002779 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.002904 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.003111 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.003238 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.003416 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.003542 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.003730 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.003855 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.004042 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.004179 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.004344 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.004459 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.004648 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.004762 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.004950 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.005073 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.005277 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.005418 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.005584 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.005709 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.005923 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.006067 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.006243 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.006379 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.006577 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.006694 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.006889 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.006985 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.007198 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.007284 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.007527 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.007621 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.007841 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.007938 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.008148 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.008236 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.008461 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.008549 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.008768 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.008857 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.009076 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.009161 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.009388 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.009484 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.009728 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.009821 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.010036 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.010125 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.010343 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.010442 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.010650 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.010752 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.010961 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.011077 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.011263 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.011389 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.011568 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.011707 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.011870 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.012023 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.012197 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.012340 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.012504 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.012657 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.012833 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.012967 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.013144 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.013303 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.013447 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.013635 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.013777 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.013944 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.014080 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.014819 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.015003 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.015130 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.015320 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.015447 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.015626 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.015755 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.015934 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.016060 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.016246 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.016398 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.016566 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.016656 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.016875 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.016971 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.017204 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.017293 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.017519 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.017685 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.017850 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.017948 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.018160 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.018257 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.018474 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.018569 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.018807 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.018894 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.019115 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.019214 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.019429 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.019506 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.019749 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.019834 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.020078 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.020313 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.020401 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.020645 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.020764 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.020960 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.021076 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.021276 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.021392 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.021612 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.021757 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.021930 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.022073 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.022245 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.022373 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.022556 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.022683 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.022878 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.023034 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.023182 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.023296 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.023493 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.023609 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.023823 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.024058 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.024180 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.024396 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.024533 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.024718 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.024847 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.025041 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.025168 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.025365 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.025523 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.025702 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.025809 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.026022 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.026109 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.026338 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.026432 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.026656 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.026755 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.026973 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.027061 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.027289 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.027376 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.027609 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.027698 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.027928 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.028015 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.028242 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.028336 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.028555 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.028645 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.028873 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.028968 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.029187 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.029283 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.029502 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.029610 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.029879 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.029970 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.030201 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.030316 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.030517 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.030608 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.030845 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.030945 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.031182 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.031404 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.031700 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.031781 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.031856 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.031929 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.032106 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.032197 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.032425 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.032513 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.032753 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.032958 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.033076 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.033275 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.033394 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.033632 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.033736 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.033962 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.034104 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.034289 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.034389 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.034607 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.034695 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.034926 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.035021 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.035255 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.035342 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.035562 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.035649 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.035870 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.035959 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.036180 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.036274 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.036491 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.036726 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.036822 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.037049 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.037137 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.037389 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.037484 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.037722 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.037824 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.038045 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.038133 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.038358 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.038445 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.038686 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.038898 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.039018 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.039252 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.039340 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.039573 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.039669 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.039910 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.040005 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.040230 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.040346 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.040544 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.040642 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.040851 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.040939 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.041170 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.041258 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.041477 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.041597 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.041815 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.041956 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.042131 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.042225 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.042442 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.042671 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.042766 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.043026 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.043122 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.043347 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.043443 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.043655 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.043743 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.043961 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.044048 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.044275 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.044379 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.044579 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.044668 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.044909 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.044997 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.045227 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.045338 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.046060 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.046151 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.046386 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.046483 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.046755 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.046843 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.047062 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.047156 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.047368 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.047457 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.047679 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.047769 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.047982 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.048076 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.048295 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.048383 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.048602 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.048691 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.048911 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.049004 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.049217 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.049304 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.049528 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.049651 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.049863 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.049964 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.050176 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.050272 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.050494 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.050584 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.050805 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.050902 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.051111 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.051208 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.051418 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.051506 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.051724 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.051811 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.052035 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.052135 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.052342 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.052429 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.052657 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.052745 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.052965 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.053061 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.053280 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.053367 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.053651 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.053742 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.053970 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.054193 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.054288 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.054534 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.054634 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.054855 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.054952 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.055185 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.055272 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.055506 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.055593 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.055812 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.055907 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.056121 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.056215 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.056429 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.056517 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.056740 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.056836 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.057053 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.057143 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.057365 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.057458 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.057703 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.058104 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.058206 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.058286 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.058366 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.058608 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.058776 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.058920 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.059015 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.059231 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.059319 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.059541 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.059637 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.059911 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.060021 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.060159 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.060247 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.060465 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.060560 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.060774 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.060863 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.061656 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.061802 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.061973 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.062073 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.062289 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.062481 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.062604 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.062693 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.062920 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.063011 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.063235 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.063321 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.063545 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.063632 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.063854 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.063951 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.064163 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.064252 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.064474 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.064573 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.064782 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.064869 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.065094 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.065188 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.065409 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.065512 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.065748 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.065840 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.066057 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.066145 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.066405 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.066725 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.066812 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.067043 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.067138 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.067362 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.067457 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.067681 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.067769 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.067995 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.068082 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.068305 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.068403 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.068617 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.068705 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.068934 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.069020 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.069258 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.069359 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.069592 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.069684 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.069901 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.069988 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.070258 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.070591 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.070685 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.070913 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.071000 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.071219 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.071313 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.071525 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.071612 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.071833 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.071921 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.072144 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.072240 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.072462 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.072551 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.072773 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.072867 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.073077 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.073166 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.073388 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.073477 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.073742 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.073831 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.074049 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.074145 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.074356 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.074482 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.074662 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.074751 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.074967 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.075063 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.075275 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.075368 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.075579 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.075673 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.075884 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.075979 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.076187 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.076274 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.076489 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.076589 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.076819 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.076992 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.077126 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.077215 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.077449 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.077566 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.077784 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.077874 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.078093 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.078189 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.078449 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.078556 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.078709 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.078805 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.079020 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.079107 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.079325 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.079420 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.079632 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.079719 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.079940 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.080028 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.080248 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.080337 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.080555 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.080643 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.080862 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.080949 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.081173 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.081274 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.081478 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.081605 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.081814 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.081903 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.082122 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.082211 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.082428 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.082517 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.082733 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.082821 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.083070 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.083160 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.083383 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.083470 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.083698 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.083794 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.084009 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.084098 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.084322 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.084413 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.084632 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.084733 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.084948 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.085044 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.085273 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.085361 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.085602 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.085708 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.085933 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.086022 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.086247 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.086343 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.086567 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.086655 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.086884 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.086974 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.087196 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.087291 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.087510 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.087598 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.087825 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.087918 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.088134 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.088223 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.088445 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.088542 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.088756 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.088914 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.089068 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.089165 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.089384 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.089471 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.089723 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.089814 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.090037 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.090145 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.090354 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.090443 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.090671 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.090758 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.090988 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.091088 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.091322 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.091416 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.091635 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.091722 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.091948 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.092035 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.092295 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.092387 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.092708 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.092865 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.093051 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.093164 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.093345 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.093517 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.093690 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.093871 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.094010 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.094187 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.094333 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.094502 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.094654 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.094810 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.094987 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.095077 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 16 09:41:31.095322 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.095639 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.095972 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.096305 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.096656 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.096977 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.097329 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.097690 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.098011 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.098328 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.098641 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:41:31.098889 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 16 09:41:31.249975 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: INFO dbcounter [None req-a30ca25c-de3a-4540-8e33-e1ea06ca8081 None None] Registered counter for database nova_api Sep 16 09:41:31.255308 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: INFO dbcounter [None req-d60faa25-1663-44db-9896-6a159f00d7fa None None] Registered counter for database nova_api Sep 16 09:41:31.270122 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG oslo_db.sqlalchemy.engines [None req-a30ca25c-de3a-4540-8e33-e1ea06ca8081 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112638) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 09:41:31.276791 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG dbcounter [-] [112638] Writer thread running {{(pid=112638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 09:41:31.276939 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG oslo_db.sqlalchemy.engines [None req-d60faa25-1663-44db-9896-6a159f00d7fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112637) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 09:41:31.283680 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG dbcounter [-] [112637] Writer thread running {{(pid=112637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 09:41:31.336620 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.context [None req-a30ca25c-de3a-4540-8e33-e1ea06ca8081 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6dc1d2d4-28ba-4d76-b176-2388586d08d4(cell1) {{(pid=112638) load_cells /opt/stack/nova/nova/context.py:464}} Sep 16 09:41:31.340767 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG oslo_concurrency.lockutils [None req-a30ca25c-de3a-4540-8e33-e1ea06ca8081 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:41:31.340934 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.context [None req-d60faa25-1663-44db-9896-6a159f00d7fa None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6dc1d2d4-28ba-4d76-b176-2388586d08d4(cell1) {{(pid=112637) load_cells /opt/stack/nova/nova/context.py:464}} Sep 16 09:41:31.341247 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG oslo_concurrency.lockutils [None req-a30ca25c-de3a-4540-8e33-e1ea06ca8081 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:41:31.343163 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG oslo_concurrency.lockutils [None req-a30ca25c-de3a-4540-8e33-e1ea06ca8081 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:41:31.343901 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG oslo_concurrency.lockutils [None req-a30ca25c-de3a-4540-8e33-e1ea06ca8081 None None] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:41:31.344352 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG oslo_concurrency.lockutils [None req-a30ca25c-de3a-4540-8e33-e1ea06ca8081 None None] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:41:31.344951 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG oslo_concurrency.lockutils [None req-d60faa25-1663-44db-9896-6a159f00d7fa None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:41:31.345360 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG oslo_concurrency.lockutils [None req-d60faa25-1663-44db-9896-6a159f00d7fa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:41:31.347012 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG oslo_concurrency.lockutils [None req-a30ca25c-de3a-4540-8e33-e1ea06ca8081 None None] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:41:31.347124 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG oslo_concurrency.lockutils [None req-d60faa25-1663-44db-9896-6a159f00d7fa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:41:31.347823 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG oslo_concurrency.lockutils [None req-d60faa25-1663-44db-9896-6a159f00d7fa None None] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:41:31.348310 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG oslo_concurrency.lockutils [None req-d60faa25-1663-44db-9896-6a159f00d7fa None None] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:41:31.349093 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: INFO dbcounter [None req-a30ca25c-de3a-4540-8e33-e1ea06ca8081 None None] Registered counter for database nova_cell0 Sep 16 09:41:31.350397 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG oslo_concurrency.lockutils [None req-d60faa25-1663-44db-9896-6a159f00d7fa None None] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:41:31.352498 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: INFO dbcounter [None req-d60faa25-1663-44db-9896-6a159f00d7fa None None] Registered counter for database nova_cell0 Sep 16 09:41:31.353619 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: INFO dbcounter [None req-a30ca25c-de3a-4540-8e33-e1ea06ca8081 None None] Registered counter for database nova_cell1 Sep 16 09:41:31.356802 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: INFO dbcounter [None req-d60faa25-1663-44db-9896-6a159f00d7fa None None] Registered counter for database nova_cell1 Sep 16 09:41:31.362703 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG oslo_db.sqlalchemy.engines [None req-a30ca25c-de3a-4540-8e33-e1ea06ca8081 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112638) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 09:41:31.364438 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG oslo_db.sqlalchemy.engines [None req-a30ca25c-de3a-4540-8e33-e1ea06ca8081 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112638) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 09:41:31.366598 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG oslo_db.sqlalchemy.engines [None req-d60faa25-1663-44db-9896-6a159f00d7fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112637) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 09:41:31.369060 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG oslo_db.sqlalchemy.engines [None req-d60faa25-1663-44db-9896-6a159f00d7fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112637) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 09:41:31.370390 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG dbcounter [-] [112638] Writer thread running {{(pid=112638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 09:41:31.375077 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG dbcounter [-] [112637] Writer thread running {{(pid=112637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 09:41:31.376895 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG dbcounter [-] [112637] Writer thread running {{(pid=112637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 09:41:31.377716 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG dbcounter [-] [112638] Writer thread running {{(pid=112638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 09:41:31.526266 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: INFO dbcounter [None req-d60faa25-1663-44db-9896-6a159f00d7fa None None] Registered counter for database nova_cell0 Sep 16 09:41:31.527631 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: INFO dbcounter [None req-a30ca25c-de3a-4540-8e33-e1ea06ca8081 None None] Registered counter for database nova_cell0 Sep 16 09:41:31.535808 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG oslo_db.sqlalchemy.engines [None req-d60faa25-1663-44db-9896-6a159f00d7fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112637) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 09:41:31.537735 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG oslo_db.sqlalchemy.engines [None req-a30ca25c-de3a-4540-8e33-e1ea06ca8081 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112638) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 09:41:31.540889 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG dbcounter [-] [112637] Writer thread running {{(pid=112637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 09:41:31.542624 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG dbcounter [-] [112638] Writer thread running {{(pid=112638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 09:41:31.935771 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: WARNING keystonemiddleware.auth_token [None req-d60faa25-1663-44db-9896-6a159f00d7fa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 16 09:41:31.943897 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: WARNING keystonemiddleware.auth_token [None req-d60faa25-1663-44db-9896-6a159f00d7fa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 16 09:41:31.972463 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: WARNING keystonemiddleware.auth_token [None req-a30ca25c-de3a-4540-8e33-e1ea06ca8081 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 16 09:41:31.979918 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: WARNING keystonemiddleware.auth_token [None req-a30ca25c-de3a-4540-8e33-e1ea06ca8081 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 16 09:41:32.291107 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: WARNING keystonemiddleware.auth_token [None req-d60faa25-1663-44db-9896-6a159f00d7fa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 16 09:41:32.297919 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: WARNING keystonemiddleware.auth_token [None req-d60faa25-1663-44db-9896-6a159f00d7fa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 16 09:41:32.303470 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5638cea519c0 pid: 112637 (default app) Sep 16 09:41:32.305563 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi [None req-d60faa25-1663-44db-9896-6a159f00d7fa None None] Calling method '>' {{(pid=112637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:41:32.306763 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: INFO nova.api.openstack.requestlog [None req-d60faa25-1663-44db-9896-6a159f00d7fa None None] 10.222.0.73 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001764 Sep 16 09:41:32.307185 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: [pid: 112637|app: 0|req: 1/1] 10.222.0.73 () {50 vars in 788 bytes} [Fri Sep 16 09:41:32 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:41:32.335051 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: WARNING keystonemiddleware.auth_token [None req-a30ca25c-de3a-4540-8e33-e1ea06ca8081 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 16 09:41:32.341141 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: WARNING keystonemiddleware.auth_token [None req-a30ca25c-de3a-4540-8e33-e1ea06ca8081 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 16 09:41:32.347357 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5638cea519c0 pid: 112638 (default app) Sep 16 09:42:59.378126 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi [None req-d60faa25-1663-44db-9896-6a159f00d7fa None None] Calling method '>' {{(pid=112637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:42:59.379152 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: INFO nova.api.openstack.requestlog [None req-d60faa25-1663-44db-9896-6a159f00d7fa None None] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Sep 16 09:42:59.379549 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: [pid: 112637|app: 0|req: 2/2] 10.222.0.73 () {54 vars in 931 bytes} [Fri Sep 16 09:42:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:42:59.391998 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG dbcounter [-] [112638] Writing DB stats nova_api:SELECT=3 {{(pid=112638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:42:59.393357 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG dbcounter [-] [112638] Writing DB stats nova_cell1:SELECT=3 {{(pid=112638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:42:59.394268 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG dbcounter [-] [112638] Writing DB stats nova_cell0:SELECT=3 {{(pid=112638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:42:59.397154 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG dbcounter [-] [112638] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:43:00.292367 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi [None req-ba98241f-4f39-49e8-92a6-bfb16e865326 admin admin] Calling method '>' {{(pid=112638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:43:00.325863 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: INFO nova.api.openstack.requestlog [None req-ba98241f-4f39-49e8-92a6-bfb16e865326 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.939306 Sep 16 09:43:00.327132 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: [pid: 112638|app: 0|req: 1/3] 10.222.0.73 () {60 vars in 1292 bytes} [Fri Sep 16 09:42:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:43:03.063206 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi [None req-d60faa25-1663-44db-9896-6a159f00d7fa None None] Calling method '>' {{(pid=112637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:43:03.064214 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: INFO nova.api.openstack.requestlog [None req-d60faa25-1663-44db-9896-6a159f00d7fa None None] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Sep 16 09:43:03.065188 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: [pid: 112637|app: 0|req: 3/4] 10.222.0.73 () {54 vars in 931 bytes} [Fri Sep 16 09:43:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:43:03.583518 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi [None req-69d94294-a110-4430-a765-9fccf839633e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "vcpus": 1, "ram": 256, "disk": 1, "os-flavor-access:is_public": true}} {{(pid=112638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:43:03.729750 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: INFO nova.api.openstack.requestlog [None req-69d94294-a110-4430-a765-9fccf839633e admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.654715 Sep 16 09:43:03.730311 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: [pid: 112638|app: 0|req: 2/5] 10.222.0.73 () {64 vars in 1283 bytes} [Fri Sep 16 09:43:03 2022] POST /compute/v2.1/flavors => generated 407 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 09:43:03.744764 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG dbcounter [-] [112637] Writing DB stats nova_api:SELECT=3 {{(pid=112637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:43:03.745630 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG dbcounter [-] [112637] Writing DB stats nova_cell1:SELECT=3 {{(pid=112637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:43:03.748370 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG dbcounter [-] [112637] Writing DB stats nova_cell0:SELECT=3 {{(pid=112637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:43:03.749453 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG dbcounter [-] [112637] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:43:03.955272 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi [None req-89f4263d-810a-43c7-b65f-2adb04bd147e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:43:04.081683 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: INFO nova.api.openstack.requestlog [None req-89f4263d-810a-43c7-b65f-2adb04bd147e admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.342062 Sep 16 09:43:04.082590 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: [pid: 112637|app: 0|req: 4/6] 10.222.0.73 () {64 vars in 1336 bytes} [Fri Sep 16 09:43:03 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:43:06.751537 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi [None req-69d94294-a110-4430-a765-9fccf839633e admin admin] Calling method '>' {{(pid=112638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:43:06.752785 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: INFO nova.api.openstack.requestlog [None req-69d94294-a110-4430-a765-9fccf839633e admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001693 Sep 16 09:43:06.753316 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: [pid: 112638|app: 0|req: 3/7] 10.222.0.73 () {54 vars in 931 bytes} [Fri Sep 16 09:43:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:43:07.566096 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi [None req-8eff0717-a440-4c5d-a4b6-9738d9449731 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "swap": 0, "name": "ds512M", "vcpus": 1, "id": "d1", "os-flavor-access:is_public": true, "disk": 5}} {{(pid=112637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:43:07.718891 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: INFO nova.api.openstack.requestlog [None req-8eff0717-a440-4c5d-a4b6-9738d9449731 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.958657 Sep 16 09:43:07.719818 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: [pid: 112637|app: 0|req: 5/8] 10.222.0.73 () {64 vars in 1283 bytes} [Fri Sep 16 09:43:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 09:43:07.739439 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi [None req-91485c50-28c1-4346-a6b4-d25395ca3734 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:43:07.857436 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: INFO nova.api.openstack.requestlog [None req-91485c50-28c1-4346-a6b4-d25395ca3734 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.122768 Sep 16 09:43:07.861723 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: [pid: 112638|app: 0|req: 4/9] 10.222.0.73 () {64 vars in 1336 bytes} [Fri Sep 16 09:43:07 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:43:10.844713 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi [None req-8eff0717-a440-4c5d-a4b6-9738d9449731 admin admin] Calling method '>' {{(pid=112637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:43:10.845784 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: INFO nova.api.openstack.requestlog [None req-8eff0717-a440-4c5d-a4b6-9738d9449731 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Sep 16 09:43:10.846375 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: [pid: 112637|app: 0|req: 6/10] 10.222.0.73 () {54 vars in 931 bytes} [Fri Sep 16 09:43:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 09:43:11.407965 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi [None req-8b4ab08e-257b-4ea5-b878-16d4c84255da admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 1024, "name": "ds1G", "rxtx_factor": 1.0, "vcpus": 1, "id": "d2", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10}} {{(pid=112638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:43:11.493403 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: INFO nova.api.openstack.requestlog [None req-8b4ab08e-257b-4ea5-b878-16d4c84255da admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.640067 Sep 16 09:43:11.494059 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: [pid: 112638|app: 0|req: 5/11] 10.222.0.73 () {64 vars in 1283 bytes} [Fri Sep 16 09:43:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 09:43:11.509978 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi [None req-f5ea8e90-6d6b-4329-b35f-fc471ebca31c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:43:11.605156 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: INFO nova.api.openstack.requestlog [None req-f5ea8e90-6d6b-4329-b35f-fc471ebca31c admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.099264 Sep 16 09:43:11.605842 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: [pid: 112637|app: 0|req: 7/12] 10.222.0.73 () {64 vars in 1336 bytes} [Fri Sep 16 09:43:11 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:43:14.435237 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi [None req-8b4ab08e-257b-4ea5-b878-16d4c84255da admin admin] Calling method '>' {{(pid=112638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:43:14.436885 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: INFO nova.api.openstack.requestlog [None req-8b4ab08e-257b-4ea5-b878-16d4c84255da admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002110 Sep 16 09:43:14.437284 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: [pid: 112638|app: 0|req: 6/13] 10.222.0.73 () {54 vars in 931 bytes} [Fri Sep 16 09:43:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:43:15.125939 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi [None req-d61fb630-25dd-4216-8fa7-61ebf89407e9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "ram": 2048, "id": "d3", "name": "ds2G", "os-flavor-access:is_public": true, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0}} {{(pid=112637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:43:15.233352 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: INFO nova.api.openstack.requestlog [None req-d61fb630-25dd-4216-8fa7-61ebf89407e9 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.788913 Sep 16 09:43:15.235045 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: [pid: 112637|app: 0|req: 8/14] 10.222.0.73 () {64 vars in 1283 bytes} [Fri Sep 16 09:43:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 16 09:43:15.251496 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi [None req-b9441870-6196-4e2f-a4aa-1c398d44eec2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:43:15.361460 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: INFO nova.api.openstack.requestlog [None req-b9441870-6196-4e2f-a4aa-1c398d44eec2 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.115589 Sep 16 09:43:15.362422 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: [pid: 112638|app: 0|req: 7/15] 10.222.0.73 () {64 vars in 1336 bytes} [Fri Sep 16 09:43:15 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:43:18.239854 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi [None req-d61fb630-25dd-4216-8fa7-61ebf89407e9 admin admin] Calling method '>' {{(pid=112637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:43:18.240938 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: INFO nova.api.openstack.requestlog [None req-d61fb630-25dd-4216-8fa7-61ebf89407e9 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Sep 16 09:43:18.241492 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: [pid: 112637|app: 0|req: 9/16] 10.222.0.73 () {54 vars in 931 bytes} [Fri Sep 16 09:43:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:43:18.659704 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi [None req-e4adac19-f9a1-4b3e-94c1-7c2da1ef4218 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 20, "name": "ds4G", "vcpus": 4, "os-flavor-access:is_public": true, "id": "d4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096}} {{(pid=112638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:43:18.777487 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: INFO nova.api.openstack.requestlog [None req-e4adac19-f9a1-4b3e-94c1-7c2da1ef4218 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.529117 Sep 16 09:43:18.778047 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: [pid: 112638|app: 0|req: 8/17] 10.222.0.73 () {64 vars in 1283 bytes} [Fri Sep 16 09:43:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 09:43:18.790826 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi [None req-a9b914a3-ab0e-48fc-866e-e288269e91ac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:43:18.878724 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: INFO nova.api.openstack.requestlog [None req-a9b914a3-ab0e-48fc-866e-e288269e91ac admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091732 Sep 16 09:43:18.879312 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: [pid: 112637|app: 0|req: 10/18] 10.222.0.73 () {64 vars in 1336 bytes} [Fri Sep 16 09:43:18 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:43:21.693899 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi [None req-e4adac19-f9a1-4b3e-94c1-7c2da1ef4218 admin admin] Calling method '>' {{(pid=112638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:43:21.695105 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: INFO nova.api.openstack.requestlog [None req-e4adac19-f9a1-4b3e-94c1-7c2da1ef4218 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001762 Sep 16 09:43:21.695576 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: [pid: 112638|app: 0|req: 9/19] 10.222.0.73 () {54 vars in 931 bytes} [Fri Sep 16 09:43:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:43:22.179719 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi [None req-c911ba69-6522-4055-a8ef-08b2322e479c admin admin] Calling method '>' {{(pid=112637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:43:22.207190 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: INFO nova.api.openstack.requestlog [None req-c911ba69-6522-4055-a8ef-08b2322e479c admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.503999 Sep 16 09:43:22.207645 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: [pid: 112637|app: 0|req: 11/20] 10.222.0.73 () {60 vars in 1292 bytes} [Fri Sep 16 09:43:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:43:25.138317 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi [None req-e4adac19-f9a1-4b3e-94c1-7c2da1ef4218 admin admin] Calling method '>' {{(pid=112638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:43:25.140604 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: INFO nova.api.openstack.requestlog [None req-e4adac19-f9a1-4b3e-94c1-7c2da1ef4218 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002726 Sep 16 09:43:25.141032 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: [pid: 112638|app: 0|req: 10/21] 10.222.0.73 () {54 vars in 931 bytes} [Fri Sep 16 09:43:25 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:43:25.634187 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi [None req-9f012ece-9b9a-4e87-8d7e-9185b2ab3782 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "1", "ram": 512, "swap": 0, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1}} {{(pid=112637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:43:25.739272 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: INFO nova.api.openstack.requestlog [None req-9f012ece-9b9a-4e87-8d7e-9185b2ab3782 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.591205 Sep 16 09:43:25.740703 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: [pid: 112637|app: 0|req: 12/22] 10.222.0.73 () {64 vars in 1283 bytes} [Fri Sep 16 09:43:25 2022] POST /compute/v2.1/flavors => generated 402 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 09:43:25.753807 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi [None req-8da74522-a208-4f1e-a25d-ed3bfbe04af4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:43:25.868685 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: INFO nova.api.openstack.requestlog [None req-8da74522-a208-4f1e-a25d-ed3bfbe04af4 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.118518 Sep 16 09:43:25.869655 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: [pid: 112638|app: 0|req: 11/23] 10.222.0.73 () {64 vars in 1333 bytes} [Fri Sep 16 09:43:25 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:43:28.710493 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi [None req-9f012ece-9b9a-4e87-8d7e-9185b2ab3782 admin admin] Calling method '>' {{(pid=112637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:43:28.711553 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: INFO nova.api.openstack.requestlog [None req-9f012ece-9b9a-4e87-8d7e-9185b2ab3782 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Sep 16 09:43:28.711998 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: [pid: 112637|app: 0|req: 13/24] 10.222.0.73 () {54 vars in 931 bytes} [Fri Sep 16 09:43:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:43:29.140212 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi [None req-4be0fb11-25dc-41b0-84f4-c43cdc810c45 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "name": "m1.small", "swap": 0, "ram": 2048, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2"}} {{(pid=112638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:43:29.236202 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: INFO nova.api.openstack.requestlog [None req-4be0fb11-25dc-41b0-84f4-c43cdc810c45 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.514803 Sep 16 09:43:29.237661 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: [pid: 112638|app: 0|req: 12/25] 10.222.0.73 () {64 vars in 1283 bytes} [Fri Sep 16 09:43:28 2022] POST /compute/v2.1/flavors => generated 405 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 09:43:29.253301 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi [None req-bfa79bb4-2f7e-4ba3-9dcb-f65ae5906395 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:43:29.344639 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: INFO nova.api.openstack.requestlog [None req-bfa79bb4-2f7e-4ba3-9dcb-f65ae5906395 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098097 Sep 16 09:43:29.345270 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: [pid: 112637|app: 0|req: 14/26] 10.222.0.73 () {64 vars in 1333 bytes} [Fri Sep 16 09:43:29 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:43:32.189020 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi [None req-4be0fb11-25dc-41b0-84f4-c43cdc810c45 admin admin] Calling method '>' {{(pid=112638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:43:32.192064 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: INFO nova.api.openstack.requestlog [None req-4be0fb11-25dc-41b0-84f4-c43cdc810c45 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001656 Sep 16 09:43:32.192064 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: [pid: 112638|app: 0|req: 13/27] 10.222.0.73 () {54 vars in 931 bytes} [Fri Sep 16 09:43:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 09:43:32.656941 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi [None req-a1712587-7ee9-463a-ac2c-8ed7be2145fa admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "ram": 4096, "os-flavor-access:is_public": true, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "id": "3", "vcpus": 2}} {{(pid=112637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:43:32.737889 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: INFO nova.api.openstack.requestlog [None req-a1712587-7ee9-463a-ac2c-8ed7be2145fa admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.540168 Sep 16 09:43:32.740654 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: [pid: 112637|app: 0|req: 15/28] 10.222.0.73 () {64 vars in 1283 bytes} [Fri Sep 16 09:43:32 2022] POST /compute/v2.1/flavors => generated 406 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 09:43:32.751983 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi [None req-612c250d-0799-4b29-b788-735ed894404d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:43:32.758668 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG dbcounter [-] [112638] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=112638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:43:32.860342 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: INFO nova.api.openstack.requestlog [None req-612c250d-0799-4b29-b788-735ed894404d admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113384 Sep 16 09:43:32.861100 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: [pid: 112638|app: 0|req: 14/29] 10.222.0.73 () {64 vars in 1333 bytes} [Fri Sep 16 09:43:32 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:43:35.580135 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi [None req-a1712587-7ee9-463a-ac2c-8ed7be2145fa admin admin] Calling method '>' {{(pid=112637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:43:35.588223 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: INFO nova.api.openstack.requestlog [None req-a1712587-7ee9-463a-ac2c-8ed7be2145fa admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Sep 16 09:43:35.588223 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: [pid: 112637|app: 0|req: 16/30] 10.222.0.73 () {54 vars in 931 bytes} [Fri Sep 16 09:43:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:43:36.085433 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi [None req-edfed787-6b9f-4f9e-bd89-64345933ac7a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "4", "disk": 80, "name": "m1.large", "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 4}} {{(pid=112638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:43:36.203778 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: INFO nova.api.openstack.requestlog [None req-edfed787-6b9f-4f9e-bd89-64345933ac7a admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.615788 Sep 16 09:43:36.204533 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: [pid: 112638|app: 0|req: 15/31] 10.222.0.73 () {64 vars in 1283 bytes} [Fri Sep 16 09:43:35 2022] POST /compute/v2.1/flavors => generated 405 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 16 09:43:36.218683 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi [None req-3ceb4942-244a-46e8-899e-069d47ef8de3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:43:36.341885 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: INFO nova.api.openstack.requestlog [None req-3ceb4942-244a-46e8-899e-069d47ef8de3 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.128720 Sep 16 09:43:36.342878 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: [pid: 112637|app: 0|req: 17/32] 10.222.0.73 () {64 vars in 1333 bytes} [Fri Sep 16 09:43:36 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:43:39.159336 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi [None req-edfed787-6b9f-4f9e-bd89-64345933ac7a admin admin] Calling method '>' {{(pid=112638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:43:39.160991 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: INFO nova.api.openstack.requestlog [None req-edfed787-6b9f-4f9e-bd89-64345933ac7a admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002089 Sep 16 09:43:39.161425 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: [pid: 112638|app: 0|req: 16/33] 10.222.0.73 () {54 vars in 931 bytes} [Fri Sep 16 09:43:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:43:39.683596 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi [None req-3f5302b6-a714-4527-891b-58eb746b40b7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 160, "vcpus": 8, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 16384, "name": "m1.xlarge", "id": "5"}} {{(pid=112637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:43:39.685016 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG dbcounter [-] [112637] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=112637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:43:39.947309 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: INFO nova.api.openstack.requestlog [None req-3f5302b6-a714-4527-891b-58eb746b40b7 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.779152 Sep 16 09:43:39.958047 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: [pid: 112637|app: 0|req: 18/34] 10.222.0.73 () {64 vars in 1283 bytes} [Fri Sep 16 09:43:39 2022] POST /compute/v2.1/flavors => generated 408 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 09:43:39.966112 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi [None req-4d5f1a03-5a4c-4cec-86e2-d13b9c6b2508 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:43:40.077644 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: INFO nova.api.openstack.requestlog [None req-4d5f1a03-5a4c-4cec-86e2-d13b9c6b2508 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.116697 Sep 16 09:43:40.077644 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: [pid: 112638|app: 0|req: 17/35] 10.222.0.73 () {64 vars in 1333 bytes} [Fri Sep 16 09:43:39 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:43:56.975297 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi [None req-3f5302b6-a714-4527-891b-58eb746b40b7 admin admin] Calling method '>' {{(pid=112637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:43:56.976350 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: INFO nova.api.openstack.requestlog [None req-3f5302b6-a714-4527-891b-58eb746b40b7 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Sep 16 09:43:56.976752 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: [pid: 112637|app: 0|req: 19/36] 10.222.0.73 () {54 vars in 931 bytes} [Fri Sep 16 09:43:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:43:56.984026 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG dbcounter [-] [112638] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=112638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:43:57.380458 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi [None req-7e06bbb2-fd7d-4ca7-911d-c1eebf6738de admin admin] Calling method '>' {{(pid=112638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:43:57.398590 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: INFO nova.api.openstack.requestlog [None req-7e06bbb2-fd7d-4ca7-911d-c1eebf6738de admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.415538 Sep 16 09:43:57.399125 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: [pid: 112638|app: 0|req: 18/37] 10.222.0.73 () {60 vars in 1292 bytes} [Fri Sep 16 09:43:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:43:58.865992 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi [None req-3f5302b6-a714-4527-891b-58eb746b40b7 admin admin] Calling method '>' {{(pid=112637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:43:58.867004 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: INFO nova.api.openstack.requestlog [None req-3f5302b6-a714-4527-891b-58eb746b40b7 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Sep 16 09:43:58.867406 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: [pid: 112637|app: 0|req: 20/38] 10.222.0.73 () {56 vars in 1074 bytes} [Fri Sep 16 09:43:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:43:59.409461 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi [None req-2e2b69d1-5230-4508-9a2d-137b479c9577 admin admin] Calling method '>' {{(pid=112638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:43:59.414920 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: INFO nova.api.openstack.wsgi [None req-2e2b69d1-5230-4508-9a2d-137b479c9577 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 16 09:43:59.418241 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi [None req-2e2b69d1-5230-4508-9a2d-137b479c9577 admin admin] Request method failure captured: Sep 16 09:43:59.418241 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 16 09:43:59.418241 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: Accept: application/json Sep 16 09:43:59.418241 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: Accept-Encoding: gzip, deflate Sep 16 09:43:59.418241 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: Connection: keep-alive Sep 16 09:43:59.418241 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: Content-Length: 0 Sep 16 09:43:59.418241 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: Host: 10.222.0.73 Sep 16 09:43:59.418241 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: Openstack-Api-Version: compute 2.92 Sep 16 09:43:59.418241 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: Openstack-System-Scope: None Sep 16 09:43:59.418241 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: User-Agent: python-novaclient Sep 16 09:43:59.418241 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-Auth-Token: gAAAAABjJEVeXahtu3omBcQGd0pT9aB7sRj1Ja5WDb48x32oMHecRg5xdT3gXQmTkGLdRdA96DpEdTyPUc5l3p0W9YxC9Vm9197l9SgnWQegm7Bu5vYA95asZLemCkSGzUc18WQGFND_eS2yhD_9js7hs2MmshJzGOrMDTixl4j03QR965y8j-0 Sep 16 09:43:59.418241 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-Domain-Id: None Sep 16 09:43:59.418241 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-Domain-Name: None Sep 16 09:43:59.418241 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-Identity-Status: Confirmed Sep 16 09:43:59.418241 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-Is-Admin-Project: True Sep 16 09:43:59.418241 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-Openstack-Nova-Api-Version: 2.92 Sep 16 09:43:59.418241 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-Project-Domain-Id: default Sep 16 09:43:59.418241 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-Project-Domain-Name: Default Sep 16 09:43:59.418241 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-Project-Id: 21c05913226c4fa2af82369356d31409 Sep 16 09:43:59.418241 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-Project-Name: admin Sep 16 09:43:59.418241 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-Role: reader,member,admin Sep 16 09:43:59.418241 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-Roles: reader,member,admin Sep 16 09:43:59.421431 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/21c05913226c4fa2af82369356d31409"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_21c05913226c4fa2af82369356d31409", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/21c05913226c4fa2af82369356d31409"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/21c05913226c4fa2af82369356d31409"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 09:43:59.421431 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-Tenant: admin Sep 16 09:43:59.421431 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-Tenant-Id: 21c05913226c4fa2af82369356d31409 Sep 16 09:43:59.421431 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-Tenant-Name: admin Sep 16 09:43:59.421431 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-User: admin Sep 16 09:43:59.421431 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-User-Domain-Id: default Sep 16 09:43:59.421431 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-User-Domain-Name: Default Sep 16 09:43:59.421431 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-User-Id: 485572dacc4d400590547916a2abf4a3 Sep 16 09:43:59.421431 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-User-Name: admin Sep 16 09:43:59.421431 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: method: > Sep 16 09:43:59.421431 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: exception: Flavor 42 could not be found. Sep 16 09:43:59.421431 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: action_args: {'id': '42'} Sep 16 09:43:59.421431 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: {{(pid=112638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 09:43:59.421431 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:43:59.422674 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 16 09:43:59.422674 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 16 09:43:59.422674 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 16 09:43:59.422674 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 16 09:43:59.422674 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 09:43:59.422674 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 09:43:59.422674 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 16 09:43:59.422674 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 16 09:43:59.422674 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 16 09:43:59.422674 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:43:59.422674 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 16 09:43:59.422674 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 16 09:43:59.422674 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 16 09:43:59.422674 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi Sep 16 09:43:59.422674 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:43:59.422674 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi Sep 16 09:43:59.422674 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:43:59.422674 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:43:59.422674 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:43:59.424091 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 09:43:59.424091 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 09:43:59.424091 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 09:43:59.424091 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:43:59.424091 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 16 09:43:59.424091 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 09:43:59.424091 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 16 09:43:59.424091 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi Sep 16 09:43:59.424091 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:43:59.424091 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi Sep 16 09:43:59.424091 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:43:59.424091 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:43:59.424091 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:43:59.424091 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 09:43:59.424091 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 09:43:59.424091 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 16 09:43:59.424091 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi Sep 16 09:43:59.424091 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi [None req-2e2b69d1-5230-4508-9a2d-137b479c9577 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 09:43:59.425692 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: INFO nova.api.openstack.requestlog [None req-2e2b69d1-5230-4508-9a2d-137b479c9577 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.410017 Sep 16 09:43:59.425692 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: [pid: 112638|app: 0|req: 19/39] 10.222.0.73 () {60 vars in 1190 bytes} [Fri Sep 16 09:43:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 412 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 16 09:43:59.430151 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi [None req-204e33d5-0d78-4239-98f6-5b2b124b176c admin admin] Calling method '>' {{(pid=112637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:43:59.457989 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: INFO nova.api.openstack.requestlog [None req-204e33d5-0d78-4239-98f6-5b2b124b176c admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026697 Sep 16 09:43:59.457989 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: [pid: 112637|app: 0|req: 21/40] 10.222.0.73 () {60 vars in 1210 bytes} [Fri Sep 16 09:43:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 09:43:59.464945 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi [None req-800c9eb5-50e0-401a-a664-78607dc8b256 admin admin] Calling method '>' {{(pid=112638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:43:59.487672 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: INFO nova.api.openstack.requestlog [None req-800c9eb5-50e0-401a-a664-78607dc8b256 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027058 Sep 16 09:43:59.488248 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: [pid: 112638|app: 0|req: 20/41] 10.222.0.73 () {60 vars in 1210 bytes} [Fri Sep 16 09:43:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:43:59.498408 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi [None req-a8b092a4-bc82-48b4-8e85-e96a342840dd admin admin] Calling method '>' {{(pid=112637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:43:59.504153 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: INFO nova.api.openstack.wsgi [None req-a8b092a4-bc82-48b4-8e85-e96a342840dd admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 16 09:43:59.507473 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi [None req-a8b092a4-bc82-48b4-8e85-e96a342840dd admin admin] Request method failure captured: Sep 16 09:43:59.507473 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 16 09:43:59.507473 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: Accept: application/json Sep 16 09:43:59.507473 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: Accept-Encoding: gzip, deflate Sep 16 09:43:59.507473 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: Connection: keep-alive Sep 16 09:43:59.507473 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: Content-Length: 0 Sep 16 09:43:59.507473 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: Host: 10.222.0.73 Sep 16 09:43:59.507473 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: Openstack-Api-Version: compute 2.92 Sep 16 09:43:59.507473 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: Openstack-System-Scope: None Sep 16 09:43:59.507473 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: User-Agent: python-novaclient Sep 16 09:43:59.507473 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-Auth-Token: gAAAAABjJEVeXahtu3omBcQGd0pT9aB7sRj1Ja5WDb48x32oMHecRg5xdT3gXQmTkGLdRdA96DpEdTyPUc5l3p0W9YxC9Vm9197l9SgnWQegm7Bu5vYA95asZLemCkSGzUc18WQGFND_eS2yhD_9js7hs2MmshJzGOrMDTixl4j03QR965y8j-0 Sep 16 09:43:59.507473 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-Domain-Id: None Sep 16 09:43:59.507473 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-Domain-Name: None Sep 16 09:43:59.507473 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-Identity-Status: Confirmed Sep 16 09:43:59.507473 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-Is-Admin-Project: True Sep 16 09:43:59.507473 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-Openstack-Nova-Api-Version: 2.92 Sep 16 09:43:59.507473 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-Project-Domain-Id: default Sep 16 09:43:59.507473 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-Project-Domain-Name: Default Sep 16 09:43:59.507473 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-Project-Id: 21c05913226c4fa2af82369356d31409 Sep 16 09:43:59.507473 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-Project-Name: admin Sep 16 09:43:59.507473 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-Role: reader,member,admin Sep 16 09:43:59.507473 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-Roles: reader,member,admin Sep 16 09:43:59.519019 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/21c05913226c4fa2af82369356d31409"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_21c05913226c4fa2af82369356d31409", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/21c05913226c4fa2af82369356d31409"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/21c05913226c4fa2af82369356d31409"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 09:43:59.519019 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-Tenant: admin Sep 16 09:43:59.519019 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-Tenant-Id: 21c05913226c4fa2af82369356d31409 Sep 16 09:43:59.519019 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-Tenant-Name: admin Sep 16 09:43:59.519019 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-User: admin Sep 16 09:43:59.519019 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-User-Domain-Id: default Sep 16 09:43:59.519019 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-User-Domain-Name: Default Sep 16 09:43:59.519019 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-User-Id: 485572dacc4d400590547916a2abf4a3 Sep 16 09:43:59.519019 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-User-Name: admin Sep 16 09:43:59.519019 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: method: > Sep 16 09:43:59.519019 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: exception: Flavor 42 could not be found. Sep 16 09:43:59.519019 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: action_args: {'id': '42'} Sep 16 09:43:59.519019 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: {{(pid=112637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 09:43:59.519019 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:43:59.519959 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 16 09:43:59.519959 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 16 09:43:59.519959 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 16 09:43:59.519959 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 16 09:43:59.519959 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 09:43:59.519959 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 09:43:59.519959 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 16 09:43:59.519959 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 16 09:43:59.519959 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 16 09:43:59.519959 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:43:59.519959 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 16 09:43:59.519959 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 16 09:43:59.519959 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 16 09:43:59.519959 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi Sep 16 09:43:59.519959 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:43:59.519959 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi Sep 16 09:43:59.519959 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:43:59.519959 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:43:59.519959 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:43:59.521068 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 09:43:59.521068 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 09:43:59.521068 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 09:43:59.521068 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:43:59.521068 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 16 09:43:59.521068 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 09:43:59.521068 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 16 09:43:59.521068 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi Sep 16 09:43:59.521068 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:43:59.521068 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi Sep 16 09:43:59.521068 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:43:59.521068 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:43:59.521068 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:43:59.521068 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 09:43:59.521068 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 09:43:59.521068 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 16 09:43:59.521068 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi Sep 16 09:43:59.521068 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi [None req-a8b092a4-bc82-48b4-8e85-e96a342840dd admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 09:43:59.522169 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: INFO nova.api.openstack.requestlog [None req-a8b092a4-bc82-48b4-8e85-e96a342840dd admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014691 Sep 16 09:43:59.522169 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: [pid: 112637|app: 0|req: 22/42] 10.222.0.73 () {60 vars in 1190 bytes} [Fri Sep 16 09:43:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 16 09:44:00.752056 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi [None req-800c9eb5-50e0-401a-a664-78607dc8b256 admin admin] Calling method '>' {{(pid=112638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:44:00.753098 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: INFO nova.api.openstack.requestlog [None req-800c9eb5-50e0-401a-a664-78607dc8b256 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Sep 16 09:44:00.753498 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: [pid: 112638|app: 0|req: 21/43] 10.222.0.73 () {56 vars in 1074 bytes} [Fri Sep 16 09:44:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:44:01.285584 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi [None req-ef3aca00-751e-4b7c-8fe2-dbccbc2ad15f admin admin] Calling method '>' {{(pid=112637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:44:01.290682 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: INFO nova.api.openstack.wsgi [None req-ef3aca00-751e-4b7c-8fe2-dbccbc2ad15f admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 16 09:44:01.298171 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi [None req-ef3aca00-751e-4b7c-8fe2-dbccbc2ad15f admin admin] Request method failure captured: Sep 16 09:44:01.298171 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 16 09:44:01.298171 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: Accept: application/json Sep 16 09:44:01.298171 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: Accept-Encoding: gzip, deflate Sep 16 09:44:01.298171 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: Connection: keep-alive Sep 16 09:44:01.298171 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: Content-Length: 0 Sep 16 09:44:01.298171 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: Host: 10.222.0.73 Sep 16 09:44:01.298171 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: Openstack-Api-Version: compute 2.92 Sep 16 09:44:01.298171 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: Openstack-System-Scope: None Sep 16 09:44:01.298171 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: User-Agent: python-novaclient Sep 16 09:44:01.298171 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-Auth-Token: gAAAAABjJEVg-6yr5RS5677lWfm2A0lkjcXOgdHabNNdaezwDGpfi2ilvFqmdDi0a33uqL0kZEWOqDZHn6lMmVleEEKcK2w82g_ZHvi6HTucrJt0DWUAj3Jx6LZ7Oy0S-JUawobPKkXsngKMbVEZEXOPsNrysjnuEDktjSBpltUd7QgSQ2dpnMs Sep 16 09:44:01.298171 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-Domain-Id: None Sep 16 09:44:01.298171 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-Domain-Name: None Sep 16 09:44:01.298171 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-Identity-Status: Confirmed Sep 16 09:44:01.298171 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-Is-Admin-Project: True Sep 16 09:44:01.298171 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-Openstack-Nova-Api-Version: 2.92 Sep 16 09:44:01.298171 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-Project-Domain-Id: default Sep 16 09:44:01.298171 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-Project-Domain-Name: Default Sep 16 09:44:01.298171 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-Project-Id: 21c05913226c4fa2af82369356d31409 Sep 16 09:44:01.298171 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-Project-Name: admin Sep 16 09:44:01.298171 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-Role: reader,member,admin Sep 16 09:44:01.298171 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-Roles: reader,member,admin Sep 16 09:44:01.299726 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/21c05913226c4fa2af82369356d31409"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_21c05913226c4fa2af82369356d31409", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/21c05913226c4fa2af82369356d31409"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/21c05913226c4fa2af82369356d31409"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 09:44:01.299726 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-Tenant: admin Sep 16 09:44:01.299726 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-Tenant-Id: 21c05913226c4fa2af82369356d31409 Sep 16 09:44:01.299726 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-Tenant-Name: admin Sep 16 09:44:01.299726 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-User: admin Sep 16 09:44:01.299726 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-User-Domain-Id: default Sep 16 09:44:01.299726 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-User-Domain-Name: Default Sep 16 09:44:01.299726 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-User-Id: 485572dacc4d400590547916a2abf4a3 Sep 16 09:44:01.299726 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-User-Name: admin Sep 16 09:44:01.299726 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: method: > Sep 16 09:44:01.299726 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: exception: Flavor 84 could not be found. Sep 16 09:44:01.299726 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: action_args: {'id': '84'} Sep 16 09:44:01.299726 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: {{(pid=112637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 09:44:01.299726 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:44:01.300699 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 16 09:44:01.300699 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 16 09:44:01.300699 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 16 09:44:01.300699 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 16 09:44:01.300699 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 09:44:01.300699 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 09:44:01.300699 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 16 09:44:01.300699 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 16 09:44:01.300699 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 16 09:44:01.300699 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:44:01.300699 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 16 09:44:01.300699 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 16 09:44:01.300699 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 16 09:44:01.300699 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi Sep 16 09:44:01.300699 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:44:01.300699 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi Sep 16 09:44:01.300699 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:44:01.300699 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:44:01.300699 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:44:01.302089 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 09:44:01.302089 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 09:44:01.302089 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 09:44:01.302089 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:44:01.302089 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 16 09:44:01.302089 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 09:44:01.302089 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 16 09:44:01.302089 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi Sep 16 09:44:01.302089 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:44:01.302089 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi Sep 16 09:44:01.302089 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:44:01.302089 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:44:01.302089 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:44:01.302089 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 09:44:01.302089 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 09:44:01.302089 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 16 09:44:01.302089 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi Sep 16 09:44:01.302089 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi [None req-ef3aca00-751e-4b7c-8fe2-dbccbc2ad15f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 09:44:01.303322 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: INFO nova.api.openstack.requestlog [None req-ef3aca00-751e-4b7c-8fe2-dbccbc2ad15f admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.403266 Sep 16 09:44:01.303322 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: [pid: 112637|app: 0|req: 23/44] 10.222.0.73 () {60 vars in 1190 bytes} [Fri Sep 16 09:44:00 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 404 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 16 09:44:01.303489 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi [None req-d9f61057-9f56-4ede-b7d9-4b2b460dd46e admin admin] Calling method '>' {{(pid=112638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:44:01.318960 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: INFO nova.api.openstack.requestlog [None req-d9f61057-9f56-4ede-b7d9-4b2b460dd46e admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019177 Sep 16 09:44:01.319504 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: [pid: 112638|app: 0|req: 22/45] 10.222.0.73 () {60 vars in 1210 bytes} [Fri Sep 16 09:44:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 09:44:01.329836 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi [None req-8af5c769-c6fe-4405-a083-7303fe370739 admin admin] Calling method '>' {{(pid=112637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:44:01.345385 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: INFO nova.api.openstack.requestlog [None req-8af5c769-c6fe-4405-a083-7303fe370739 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019820 Sep 16 09:44:01.345953 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: [pid: 112637|app: 0|req: 24/46] 10.222.0.73 () {60 vars in 1210 bytes} [Fri Sep 16 09:44:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:44:01.355203 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi [None req-9ec4e4d8-eaca-43eb-8d89-18e5fc1bf20e admin admin] Calling method '>' {{(pid=112638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:44:01.360323 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: INFO nova.api.openstack.wsgi [None req-9ec4e4d8-eaca-43eb-8d89-18e5fc1bf20e admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 16 09:44:01.361873 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi [None req-9ec4e4d8-eaca-43eb-8d89-18e5fc1bf20e admin admin] Request method failure captured: Sep 16 09:44:01.361873 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 16 09:44:01.361873 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: Accept: application/json Sep 16 09:44:01.361873 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: Accept-Encoding: gzip, deflate Sep 16 09:44:01.361873 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: Connection: keep-alive Sep 16 09:44:01.361873 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: Content-Length: 0 Sep 16 09:44:01.361873 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: Host: 10.222.0.73 Sep 16 09:44:01.361873 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: Openstack-Api-Version: compute 2.92 Sep 16 09:44:01.361873 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: Openstack-System-Scope: None Sep 16 09:44:01.361873 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: User-Agent: python-novaclient Sep 16 09:44:01.361873 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-Auth-Token: gAAAAABjJEVg-6yr5RS5677lWfm2A0lkjcXOgdHabNNdaezwDGpfi2ilvFqmdDi0a33uqL0kZEWOqDZHn6lMmVleEEKcK2w82g_ZHvi6HTucrJt0DWUAj3Jx6LZ7Oy0S-JUawobPKkXsngKMbVEZEXOPsNrysjnuEDktjSBpltUd7QgSQ2dpnMs Sep 16 09:44:01.361873 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-Domain-Id: None Sep 16 09:44:01.361873 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-Domain-Name: None Sep 16 09:44:01.361873 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-Identity-Status: Confirmed Sep 16 09:44:01.361873 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-Is-Admin-Project: True Sep 16 09:44:01.361873 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-Openstack-Nova-Api-Version: 2.92 Sep 16 09:44:01.361873 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-Project-Domain-Id: default Sep 16 09:44:01.361873 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-Project-Domain-Name: Default Sep 16 09:44:01.361873 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-Project-Id: 21c05913226c4fa2af82369356d31409 Sep 16 09:44:01.361873 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-Project-Name: admin Sep 16 09:44:01.361873 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-Role: reader,member,admin Sep 16 09:44:01.361873 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-Roles: reader,member,admin Sep 16 09:44:01.363421 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/21c05913226c4fa2af82369356d31409"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_21c05913226c4fa2af82369356d31409", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/21c05913226c4fa2af82369356d31409"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/21c05913226c4fa2af82369356d31409"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 09:44:01.363421 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-Tenant: admin Sep 16 09:44:01.363421 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-Tenant-Id: 21c05913226c4fa2af82369356d31409 Sep 16 09:44:01.363421 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-Tenant-Name: admin Sep 16 09:44:01.363421 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-User: admin Sep 16 09:44:01.363421 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-User-Domain-Id: default Sep 16 09:44:01.363421 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-User-Domain-Name: Default Sep 16 09:44:01.363421 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-User-Id: 485572dacc4d400590547916a2abf4a3 Sep 16 09:44:01.363421 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-User-Name: admin Sep 16 09:44:01.363421 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: method: > Sep 16 09:44:01.363421 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: exception: Flavor 84 could not be found. Sep 16 09:44:01.363421 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: action_args: {'id': '84'} Sep 16 09:44:01.363421 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: {{(pid=112638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 09:44:01.363421 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:44:01.364382 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 16 09:44:01.364382 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 16 09:44:01.364382 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 16 09:44:01.364382 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 16 09:44:01.364382 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 09:44:01.364382 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 09:44:01.364382 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 16 09:44:01.364382 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 16 09:44:01.364382 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 16 09:44:01.364382 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:44:01.364382 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 16 09:44:01.364382 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 16 09:44:01.364382 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 16 09:44:01.364382 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi Sep 16 09:44:01.364382 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:44:01.364382 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi Sep 16 09:44:01.364382 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:44:01.364382 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:44:01.364382 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:44:01.365672 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 09:44:01.365672 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 09:44:01.365672 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 09:44:01.365672 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:44:01.365672 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 16 09:44:01.365672 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 09:44:01.365672 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 16 09:44:01.365672 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi Sep 16 09:44:01.365672 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:44:01.365672 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi Sep 16 09:44:01.365672 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:44:01.365672 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:44:01.365672 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:44:01.365672 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 09:44:01.365672 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 09:44:01.365672 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 16 09:44:01.365672 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi Sep 16 09:44:01.365672 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi [None req-9ec4e4d8-eaca-43eb-8d89-18e5fc1bf20e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 09:44:01.366919 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: INFO nova.api.openstack.requestlog [None req-9ec4e4d8-eaca-43eb-8d89-18e5fc1bf20e admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011547 Sep 16 09:44:01.367264 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: [pid: 112638|app: 0|req: 23/47] 10.222.0.73 () {60 vars in 1190 bytes} [Fri Sep 16 09:44:01 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 16 09:44:02.604301 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi [None req-8af5c769-c6fe-4405-a083-7303fe370739 admin admin] Calling method '>' {{(pid=112637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:44:02.605318 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: INFO nova.api.openstack.requestlog [None req-8af5c769-c6fe-4405-a083-7303fe370739 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Sep 16 09:44:02.605742 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: [pid: 112637|app: 0|req: 25/48] 10.222.0.73 () {56 vars in 1074 bytes} [Fri Sep 16 09:44:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:44:03.143194 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi [None req-317f6ac6-dc41-4f0e-bc14-03e3910b2e92 admin admin] Calling method '>' {{(pid=112638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:44:03.149150 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: INFO nova.api.openstack.wsgi [None req-317f6ac6-dc41-4f0e-bc14-03e3910b2e92 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 16 09:44:03.150757 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi [None req-317f6ac6-dc41-4f0e-bc14-03e3910b2e92 admin admin] Request method failure captured: Sep 16 09:44:03.150757 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 16 09:44:03.150757 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: Accept: application/json Sep 16 09:44:03.150757 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: Accept-Encoding: gzip, deflate Sep 16 09:44:03.150757 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: Connection: keep-alive Sep 16 09:44:03.150757 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: Content-Length: 0 Sep 16 09:44:03.150757 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: Host: 10.222.0.73 Sep 16 09:44:03.150757 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: Openstack-Api-Version: compute 2.92 Sep 16 09:44:03.150757 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: Openstack-System-Scope: None Sep 16 09:44:03.150757 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: User-Agent: python-novaclient Sep 16 09:44:03.150757 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-Auth-Token: gAAAAABjJEVin_bXp1qpZEc668YO-Qc934MoeqnYrAigAFqd6sMobxvgFxYnlz0F4s2eKqe--YNAEPGF4oqEcvYH8jxj0g17LYsGXavJvGiVtVBC8FWBNfWhMEYfB9O_3BXayK_Ee7_uPTwbkNYYZ7qEoAXuyvQk9ym-D3Mpp94IofgxklB6Ucc Sep 16 09:44:03.150757 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-Domain-Id: None Sep 16 09:44:03.150757 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-Domain-Name: None Sep 16 09:44:03.150757 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-Identity-Status: Confirmed Sep 16 09:44:03.150757 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-Is-Admin-Project: True Sep 16 09:44:03.150757 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-Openstack-Nova-Api-Version: 2.92 Sep 16 09:44:03.150757 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-Project-Domain-Id: default Sep 16 09:44:03.150757 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-Project-Domain-Name: Default Sep 16 09:44:03.150757 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-Project-Id: 21c05913226c4fa2af82369356d31409 Sep 16 09:44:03.150757 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-Project-Name: admin Sep 16 09:44:03.150757 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-Role: reader,member,admin Sep 16 09:44:03.150757 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-Roles: reader,member,admin Sep 16 09:44:03.152327 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/21c05913226c4fa2af82369356d31409"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_21c05913226c4fa2af82369356d31409", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/21c05913226c4fa2af82369356d31409"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/21c05913226c4fa2af82369356d31409"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 09:44:03.152327 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-Tenant: admin Sep 16 09:44:03.152327 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-Tenant-Id: 21c05913226c4fa2af82369356d31409 Sep 16 09:44:03.152327 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-Tenant-Name: admin Sep 16 09:44:03.152327 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-User: admin Sep 16 09:44:03.152327 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-User-Domain-Id: default Sep 16 09:44:03.152327 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-User-Domain-Name: Default Sep 16 09:44:03.152327 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-User-Id: 485572dacc4d400590547916a2abf4a3 Sep 16 09:44:03.152327 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: X-User-Name: admin Sep 16 09:44:03.152327 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: method: > Sep 16 09:44:03.152327 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: exception: Flavor 451 could not be found. Sep 16 09:44:03.152327 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: action_args: {'id': '451'} Sep 16 09:44:03.152327 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: {{(pid=112638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 09:44:03.152327 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:44:03.153406 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 16 09:44:03.153406 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 16 09:44:03.153406 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 16 09:44:03.153406 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 16 09:44:03.153406 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 09:44:03.153406 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 09:44:03.153406 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 16 09:44:03.153406 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 16 09:44:03.153406 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 16 09:44:03.153406 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:44:03.153406 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 16 09:44:03.153406 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 16 09:44:03.153406 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 16 09:44:03.153406 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi Sep 16 09:44:03.153406 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:44:03.153406 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi Sep 16 09:44:03.153406 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:44:03.153406 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:44:03.153406 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:44:03.154956 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 09:44:03.154956 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 09:44:03.154956 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 09:44:03.154956 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:44:03.154956 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 16 09:44:03.154956 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 09:44:03.154956 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 16 09:44:03.154956 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi Sep 16 09:44:03.154956 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:44:03.154956 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi Sep 16 09:44:03.154956 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:44:03.154956 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:44:03.154956 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:44:03.154956 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 09:44:03.154956 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 09:44:03.154956 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 16 09:44:03.154956 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: ERROR nova.api.openstack.wsgi Sep 16 09:44:03.154956 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi [None req-317f6ac6-dc41-4f0e-bc14-03e3910b2e92 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 09:44:03.156306 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: INFO nova.api.openstack.requestlog [None req-317f6ac6-dc41-4f0e-bc14-03e3910b2e92 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.407728 Sep 16 09:44:03.156306 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: [pid: 112638|app: 0|req: 24/49] 10.222.0.73 () {60 vars in 1193 bytes} [Fri Sep 16 09:44:02 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 409 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 16 09:44:03.166986 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi [None req-d5ea0977-7cbe-4196-b042-e301b562eabd admin admin] Calling method '>' {{(pid=112637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:44:03.183429 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: INFO nova.api.openstack.requestlog [None req-d5ea0977-7cbe-4196-b042-e301b562eabd admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.021667 Sep 16 09:44:03.183996 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: [pid: 112637|app: 0|req: 26/50] 10.222.0.73 () {60 vars in 1210 bytes} [Fri Sep 16 09:44:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:44:03.195865 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi [None req-714db8fb-4127-48a9-ae37-50936dae635d admin admin] Calling method '>' {{(pid=112638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:44:03.212023 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: INFO nova.api.openstack.requestlog [None req-714db8fb-4127-48a9-ae37-50936dae635d admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020180 Sep 16 09:44:03.212574 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: [pid: 112638|app: 0|req: 25/51] 10.222.0.73 () {60 vars in 1210 bytes} [Fri Sep 16 09:44:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:44:03.222653 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi [None req-3c0acf5e-179c-4e1d-9254-89a95f41551a admin admin] Calling method '>' {{(pid=112637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:44:03.227689 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: INFO nova.api.openstack.wsgi [None req-3c0acf5e-179c-4e1d-9254-89a95f41551a admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 16 09:44:03.229180 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi [None req-3c0acf5e-179c-4e1d-9254-89a95f41551a admin admin] Request method failure captured: Sep 16 09:44:03.229180 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 16 09:44:03.229180 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: Accept: application/json Sep 16 09:44:03.229180 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: Accept-Encoding: gzip, deflate Sep 16 09:44:03.229180 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: Connection: keep-alive Sep 16 09:44:03.229180 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: Content-Length: 0 Sep 16 09:44:03.229180 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: Host: 10.222.0.73 Sep 16 09:44:03.229180 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: Openstack-Api-Version: compute 2.92 Sep 16 09:44:03.229180 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: Openstack-System-Scope: None Sep 16 09:44:03.229180 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: User-Agent: python-novaclient Sep 16 09:44:03.229180 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-Auth-Token: gAAAAABjJEVin_bXp1qpZEc668YO-Qc934MoeqnYrAigAFqd6sMobxvgFxYnlz0F4s2eKqe--YNAEPGF4oqEcvYH8jxj0g17LYsGXavJvGiVtVBC8FWBNfWhMEYfB9O_3BXayK_Ee7_uPTwbkNYYZ7qEoAXuyvQk9ym-D3Mpp94IofgxklB6Ucc Sep 16 09:44:03.229180 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-Domain-Id: None Sep 16 09:44:03.229180 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-Domain-Name: None Sep 16 09:44:03.229180 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-Identity-Status: Confirmed Sep 16 09:44:03.229180 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-Is-Admin-Project: True Sep 16 09:44:03.229180 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-Openstack-Nova-Api-Version: 2.92 Sep 16 09:44:03.229180 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-Project-Domain-Id: default Sep 16 09:44:03.229180 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-Project-Domain-Name: Default Sep 16 09:44:03.229180 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-Project-Id: 21c05913226c4fa2af82369356d31409 Sep 16 09:44:03.229180 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-Project-Name: admin Sep 16 09:44:03.229180 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-Role: reader,member,admin Sep 16 09:44:03.229180 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-Roles: reader,member,admin Sep 16 09:44:03.230785 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/21c05913226c4fa2af82369356d31409"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_21c05913226c4fa2af82369356d31409", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/21c05913226c4fa2af82369356d31409"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/21c05913226c4fa2af82369356d31409"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 09:44:03.230785 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-Tenant: admin Sep 16 09:44:03.230785 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-Tenant-Id: 21c05913226c4fa2af82369356d31409 Sep 16 09:44:03.230785 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-Tenant-Name: admin Sep 16 09:44:03.230785 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-User: admin Sep 16 09:44:03.230785 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-User-Domain-Id: default Sep 16 09:44:03.230785 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-User-Domain-Name: Default Sep 16 09:44:03.230785 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-User-Id: 485572dacc4d400590547916a2abf4a3 Sep 16 09:44:03.230785 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: X-User-Name: admin Sep 16 09:44:03.230785 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: method: > Sep 16 09:44:03.230785 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: exception: Flavor 451 could not be found. Sep 16 09:44:03.230785 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: action_args: {'id': '451'} Sep 16 09:44:03.230785 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: {{(pid=112637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 09:44:03.230785 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:44:03.231772 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 16 09:44:03.231772 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 16 09:44:03.231772 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 16 09:44:03.231772 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 16 09:44:03.231772 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 09:44:03.231772 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 09:44:03.231772 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 16 09:44:03.231772 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 16 09:44:03.231772 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 16 09:44:03.231772 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:44:03.231772 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 16 09:44:03.231772 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 16 09:44:03.231772 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 16 09:44:03.231772 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi Sep 16 09:44:03.231772 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:44:03.231772 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi Sep 16 09:44:03.231772 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:44:03.231772 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:44:03.231772 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:44:03.233630 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 09:44:03.233630 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 09:44:03.233630 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 09:44:03.233630 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:44:03.233630 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 16 09:44:03.233630 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 09:44:03.233630 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 16 09:44:03.233630 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi Sep 16 09:44:03.233630 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:44:03.233630 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi Sep 16 09:44:03.233630 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:44:03.233630 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:44:03.233630 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:44:03.233630 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 09:44:03.233630 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 09:44:03.233630 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 16 09:44:03.233630 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: ERROR nova.api.openstack.wsgi Sep 16 09:44:03.233630 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi [None req-3c0acf5e-179c-4e1d-9254-89a95f41551a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 09:44:03.234870 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: INFO nova.api.openstack.requestlog [None req-3c0acf5e-179c-4e1d-9254-89a95f41551a admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011588 Sep 16 09:44:03.234870 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: [pid: 112637|app: 0|req: 27/52] 10.222.0.73 () {60 vars in 1193 bytes} [Fri Sep 16 09:44:03 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 16 09:44:04.492657 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi [None req-714db8fb-4127-48a9-ae37-50936dae635d admin admin] Calling method '>' {{(pid=112638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:44:04.493713 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: INFO nova.api.openstack.requestlog [None req-714db8fb-4127-48a9-ae37-50936dae635d admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Sep 16 09:44:04.494126 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: [pid: 112638|app: 0|req: 26/53] 10.222.0.73 () {56 vars in 1074 bytes} [Fri Sep 16 09:44:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:44:05.028642 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi [None req-ea50062d-5302-4f52-a433-f9bd3320dcb3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:44:05.106640 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: INFO nova.api.openstack.requestlog [None req-ea50062d-5302-4f52-a433-f9bd3320dcb3 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.473797 Sep 16 09:44:05.109120 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: [pid: 112637|app: 0|req: 28/54] 10.222.0.73 () {64 vars in 1235 bytes} [Fri Sep 16 09:44:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 09:44:06.399385 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi [None req-714db8fb-4127-48a9-ae37-50936dae635d admin admin] Calling method '>' {{(pid=112638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:44:06.400450 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: INFO nova.api.openstack.requestlog [None req-714db8fb-4127-48a9-ae37-50936dae635d admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Sep 16 09:44:06.403723 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: [pid: 112638|app: 0|req: 27/55] 10.222.0.73 () {56 vars in 1074 bytes} [Fri Sep 16 09:44:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:44:06.930054 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi [None req-bb24c1dc-0cf5-4f68-bce8-423f33fa90fc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:44:06.999598 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: INFO nova.api.openstack.requestlog [None req-bb24c1dc-0cf5-4f68-bce8-423f33fa90fc admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.459931 Sep 16 09:44:07.000159 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: [pid: 112637|app: 0|req: 29/56] 10.222.0.73 () {64 vars in 1235 bytes} [Fri Sep 16 09:44:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 09:44:08.275111 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi [None req-714db8fb-4127-48a9-ae37-50936dae635d admin admin] Calling method '>' {{(pid=112638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:44:08.276115 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: INFO nova.api.openstack.requestlog [None req-714db8fb-4127-48a9-ae37-50936dae635d admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Sep 16 09:44:08.276562 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: [pid: 112638|app: 0|req: 28/57] 10.222.0.73 () {56 vars in 1074 bytes} [Fri Sep 16 09:44:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:44:08.823476 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi [None req-1f60251c-d096-400b-a730-274de367f948 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:44:08.895751 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: INFO nova.api.openstack.requestlog [None req-1f60251c-d096-400b-a730-274de367f948 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.471905 Sep 16 09:44:08.896296 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: [pid: 112637|app: 0|req: 30/58] 10.222.0.73 () {64 vars in 1235 bytes} [Fri Sep 16 09:44:08 2022] POST /compute/v2.1/flavors => generated 407 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 09:44:10.180281 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi [None req-714db8fb-4127-48a9-ae37-50936dae635d admin admin] Calling method '>' {{(pid=112638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:44:10.181342 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: INFO nova.api.openstack.requestlog [None req-714db8fb-4127-48a9-ae37-50936dae635d admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Sep 16 09:44:10.181770 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: [pid: 112638|app: 0|req: 29/59] 10.222.0.73 () {56 vars in 1074 bytes} [Fri Sep 16 09:44:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:44:10.725199 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi [None req-bef07180-2cc5-4c59-a8a0-699c94fd6071 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:44:10.845152 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: INFO nova.api.openstack.requestlog [None req-bef07180-2cc5-4c59-a8a0-699c94fd6071 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.519486 Sep 16 09:44:10.845741 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: [pid: 112637|app: 0|req: 31/60] 10.222.0.73 () {64 vars in 1235 bytes} [Fri Sep 16 09:44:10 2022] POST /compute/v2.1/flavors => generated 409 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 09:44:12.096108 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi [None req-714db8fb-4127-48a9-ae37-50936dae635d admin admin] Calling method '>' {{(pid=112638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:44:12.097115 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: INFO nova.api.openstack.requestlog [None req-714db8fb-4127-48a9-ae37-50936dae635d admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Sep 16 09:44:12.097513 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: [pid: 112638|app: 0|req: 30/61] 10.222.0.73 () {56 vars in 1074 bytes} [Fri Sep 16 09:44:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:44:12.642787 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi [None req-21d0c93c-5abf-4328-923d-1e4abb29f3c5 admin admin] Calling method '>' {{(pid=112637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:44:12.663588 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: INFO nova.api.openstack.requestlog [None req-21d0c93c-5abf-4328-923d-1e4abb29f3c5 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.422904 Sep 16 09:44:12.664130 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: [pid: 112637|app: 0|req: 32/62] 10.222.0.73 () {60 vars in 1202 bytes} [Fri Sep 16 09:44:12 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:45:10.276274 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi [None req-714db8fb-4127-48a9-ae37-50936dae635d admin admin] Calling method '>' {{(pid=112638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:45:10.277201 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: INFO nova.api.openstack.requestlog [None req-714db8fb-4127-48a9-ae37-50936dae635d admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Sep 16 09:45:10.278258 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: [pid: 112638|app: 0|req: 31/63] 10.222.0.73 () {54 vars in 931 bytes} [Fri Sep 16 09:45:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:45:10.288960 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG dbcounter [-] [112637] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=112637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:45:10.687678 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi [None req-39fc0287-8f03-4bfd-8531-786583833d13 admin admin] Calling method '>' {{(pid=112637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:45:10.710279 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: INFO nova.api.openstack.requestlog [None req-39fc0287-8f03-4bfd-8531-786583833d13 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.425777 Sep 16 09:45:10.710830 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: [pid: 112637|app: 0|req: 33/64] 10.222.0.73 () {60 vars in 1292 bytes} [Fri Sep 16 09:45:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:45:10.732308 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG dbcounter [-] [112638] Writing DB stats nova_api:SELECT=14 {{(pid=112638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:45:10.736027 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi [None req-afa00047-aa49-4997-902f-cb7633232ed1 admin admin] Calling method '>' {{(pid=112638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:45:10.743323 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: INFO nova.api.openstack.requestlog [None req-afa00047-aa49-4997-902f-cb7633232ed1 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013031 Sep 16 09:45:10.746196 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: [pid: 112638|app: 0|req: 32/65] 10.222.0.73 () {60 vars in 1283 bytes} [Fri Sep 16 09:45:10 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:45:10.757705 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi [None req-5b773f14-8c4d-439e-8c08-6c375e32e06a admin admin] Calling method '>' {{(pid=112637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:45:10.766221 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: INFO nova.api.openstack.requestlog [None req-5b773f14-8c4d-439e-8c08-6c375e32e06a admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012349 Sep 16 09:45:10.769113 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: [pid: 112637|app: 0|req: 34/66] 10.222.0.73 () {60 vars in 1286 bytes} [Fri Sep 16 09:45:10 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:45:10.778665 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi [None req-61a7e89b-6184-41b8-9034-dfb741e422f3 admin admin] Calling method '>' {{(pid=112638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:45:10.786681 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: INFO nova.api.openstack.requestlog [None req-61a7e89b-6184-41b8-9034-dfb741e422f3 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011661 Sep 16 09:45:10.787152 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: [pid: 112638|app: 0|req: 33/67] 10.222.0.73 () {60 vars in 1286 bytes} [Fri Sep 16 09:45:10 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:45:10.799176 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi [None req-5cfbd84f-12f9-4a7e-aa8d-e817eaa02892 admin admin] Calling method '>' {{(pid=112637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:45:10.806632 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: INFO nova.api.openstack.requestlog [None req-5cfbd84f-12f9-4a7e-aa8d-e817eaa02892 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011011 Sep 16 09:45:10.807149 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: [pid: 112637|app: 0|req: 35/68] 10.222.0.73 () {60 vars in 1283 bytes} [Fri Sep 16 09:45:10 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:48:26.774821 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi [None req-61a7e89b-6184-41b8-9034-dfb741e422f3 admin admin] Calling method '>' {{(pid=112638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:48:26.775837 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: INFO nova.api.openstack.requestlog [None req-61a7e89b-6184-41b8-9034-dfb741e422f3 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Sep 16 09:48:26.776295 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: [pid: 112638|app: 0|req: 34/69] 10.222.0.73 () {56 vars in 1074 bytes} [Fri Sep 16 09:48:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:48:26.918174 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG dbcounter [-] [112637] Writing DB stats nova_api:SELECT=6 {{(pid=112637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:48:27.081015 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi [None req-94a473c1-d752-4c2a-a81c-728c9d227a7e admin admin] Calling method '>' {{(pid=112637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:48:27.085969 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG oslo_concurrency.lockutils [None req-94a473c1-d752-4c2a-a81c-728c9d227a7e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:48:27.086451 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG oslo_concurrency.lockutils [None req-94a473c1-d752-4c2a-a81c-728c9d227a7e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:48:27.086880 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG oslo_concurrency.lockutils [None req-94a473c1-d752-4c2a-a81c-728c9d227a7e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:48:27.087592 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG oslo_concurrency.lockutils [None req-94a473c1-d752-4c2a-a81c-728c9d227a7e admin admin] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:48:27.088043 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG oslo_concurrency.lockutils [None req-94a473c1-d752-4c2a-a81c-728c9d227a7e admin admin] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:48:27.088465 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG oslo_concurrency.lockutils [None req-94a473c1-d752-4c2a-a81c-728c9d227a7e admin admin] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:48:27.121465 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: INFO nova.api.openstack.requestlog [None req-94a473c1-d752-4c2a-a81c-728c9d227a7e admin admin] 10.222.0.73 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.204451 Sep 16 09:48:27.122073 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: [pid: 112637|app: 0|req: 36/70] 10.222.0.73 () {60 vars in 1193 bytes} [Fri Sep 16 09:48:26 2022] GET /compute/v2.1/os-services => generated 794 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 09:48:28.247810 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi [None req-61a7e89b-6184-41b8-9034-dfb741e422f3 admin admin] Calling method '>' {{(pid=112638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:48:28.248822 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: INFO nova.api.openstack.requestlog [None req-61a7e89b-6184-41b8-9034-dfb741e422f3 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Sep 16 09:48:28.249258 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: [pid: 112638|app: 0|req: 35/71] 10.222.0.73 () {56 vars in 1074 bytes} [Fri Sep 16 09:48:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:48:28.449470 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi [None req-ba2be8ec-dd29-4b63-a15e-cf0310331520 admin admin] Calling method '>' {{(pid=112637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:48:28.453037 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG oslo_concurrency.lockutils [None req-ba2be8ec-dd29-4b63-a15e-cf0310331520 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:48:28.453520 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG oslo_concurrency.lockutils [None req-ba2be8ec-dd29-4b63-a15e-cf0310331520 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:48:28.454024 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG oslo_concurrency.lockutils [None req-ba2be8ec-dd29-4b63-a15e-cf0310331520 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:48:28.454697 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG oslo_concurrency.lockutils [None req-ba2be8ec-dd29-4b63-a15e-cf0310331520 admin admin] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:48:28.455150 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG oslo_concurrency.lockutils [None req-ba2be8ec-dd29-4b63-a15e-cf0310331520 admin admin] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:48:28.456133 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG oslo_concurrency.lockutils [None req-ba2be8ec-dd29-4b63-a15e-cf0310331520 admin admin] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:48:28.475262 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: INFO nova.api.openstack.requestlog [None req-ba2be8ec-dd29-4b63-a15e-cf0310331520 admin admin] 10.222.0.73 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.081386 Sep 16 09:48:28.476479 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: [pid: 112637|app: 0|req: 37/72] 10.222.0.73 () {60 vars in 1193 bytes} [Fri Sep 16 09:48:28 2022] GET /compute/v2.1/os-services => generated 794 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 09:48:40.026316 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi [None req-61a7e89b-6184-41b8-9034-dfb741e422f3 admin admin] Calling method '>' {{(pid=112638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:48:40.027325 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: INFO nova.api.openstack.requestlog [None req-61a7e89b-6184-41b8-9034-dfb741e422f3 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Sep 16 09:48:40.027726 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: [pid: 112638|app: 0|req: 36/73] 10.222.0.73 () {56 vars in 1074 bytes} [Fri Sep 16 09:48:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:48:40.174664 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG dbcounter [-] [112637] Writing DB stats nova_cell0:SELECT=4 {{(pid=112637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:48:40.175387 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG dbcounter [-] [112637] Writing DB stats nova_cell1:SELECT=4 {{(pid=112637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:48:40.175985 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG dbcounter [-] [112637] Writing DB stats nova_api:SELECT=8 {{(pid=112637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:48:40.225441 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi [None req-595e0306-933a-4302-8219-5bae0cd89fdd admin admin] Calling method '>' {{(pid=112637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:48:40.228899 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG oslo_concurrency.lockutils [None req-595e0306-933a-4302-8219-5bae0cd89fdd admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:48:40.229380 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG oslo_concurrency.lockutils [None req-595e0306-933a-4302-8219-5bae0cd89fdd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:48:40.229833 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG oslo_concurrency.lockutils [None req-595e0306-933a-4302-8219-5bae0cd89fdd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:48:40.230548 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG oslo_concurrency.lockutils [None req-595e0306-933a-4302-8219-5bae0cd89fdd admin admin] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:48:40.231003 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG oslo_concurrency.lockutils [None req-595e0306-933a-4302-8219-5bae0cd89fdd admin admin] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:48:40.231422 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG oslo_concurrency.lockutils [None req-595e0306-933a-4302-8219-5bae0cd89fdd admin admin] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:48:40.258414 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: INFO nova.api.openstack.requestlog [None req-595e0306-933a-4302-8219-5bae0cd89fdd admin admin] 10.222.0.73 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.92 time: 0.088252 Sep 16 09:48:40.258902 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: [pid: 112637|app: 0|req: 38/74] 10.222.0.73 () {60 vars in 1193 bytes} [Fri Sep 16 09:48:40 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:48:41.379401 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG nova.api.openstack.wsgi [None req-61a7e89b-6184-41b8-9034-dfb741e422f3 admin admin] Calling method '>' {{(pid=112638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:48:41.380447 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: INFO nova.api.openstack.requestlog [None req-61a7e89b-6184-41b8-9034-dfb741e422f3 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Sep 16 09:48:41.380852 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: [pid: 112638|app: 0|req: 37/75] 10.222.0.73 () {56 vars in 1074 bytes} [Fri Sep 16 09:48:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:48:41.574876 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG nova.api.openstack.wsgi [None req-dc7d59a8-b099-4e98-b7f9-ce7b75d7f2ea admin admin] Calling method '>' {{(pid=112637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:48:41.578354 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG oslo_concurrency.lockutils [None req-dc7d59a8-b099-4e98-b7f9-ce7b75d7f2ea admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:48:41.578821 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG oslo_concurrency.lockutils [None req-dc7d59a8-b099-4e98-b7f9-ce7b75d7f2ea admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:48:41.579243 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG oslo_concurrency.lockutils [None req-dc7d59a8-b099-4e98-b7f9-ce7b75d7f2ea admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:48:41.579952 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG oslo_concurrency.lockutils [None req-dc7d59a8-b099-4e98-b7f9-ce7b75d7f2ea admin admin] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:48:41.580886 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG oslo_concurrency.lockutils [None req-dc7d59a8-b099-4e98-b7f9-ce7b75d7f2ea admin admin] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:48:41.581299 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: DEBUG oslo_concurrency.lockutils [None req-dc7d59a8-b099-4e98-b7f9-ce7b75d7f2ea admin admin] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:48:41.603164 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: INFO nova.api.openstack.requestlog [None req-dc7d59a8-b099-4e98-b7f9-ce7b75d7f2ea admin admin] 10.222.0.73 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.92 time: 0.080276 Sep 16 09:48:41.603717 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: [pid: 112637|app: 0|req: 39/76] 10.222.0.73 () {60 vars in 1193 bytes} [Fri Sep 16 09:48:41 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:49:40.559818 dv-cinder-790535-43-iscsi devstack@n-api.service[112636]: Fri Sep 16 09:49:40 2022 - graceful shutdown triggered... Sep 16 09:49:40.559318 dv-cinder-790535-43-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 16 09:49:40.560830 dv-cinder-790535-43-iscsi devstack@n-api.service[112637]: Gracefully killing worker 1 (pid: 112637)... Sep 16 09:49:40.561207 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: Gracefully killing worker 2 (pid: 112638)... Sep 16 09:49:40.687188 dv-cinder-790535-43-iscsi devstack@n-api.service[112638]: DEBUG dbcounter [-] [112638] Writing DB stats nova_api:SELECT=4 {{(pid=112638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:49:41.560367 dv-cinder-790535-43-iscsi devstack@n-api.service[112636]: worker 1 buried after 1 seconds Sep 16 09:49:41.560899 dv-cinder-790535-43-iscsi devstack@n-api.service[112636]: worker 2 buried after 1 seconds Sep 16 09:49:41.560899 dv-cinder-790535-43-iscsi devstack@n-api.service[112636]: goodbye to uWSGI. Sep 16 09:49:41.562006 dv-cinder-790535-43-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 16 09:49:41.562572 dv-cinder-790535-43-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 16 09:49:41.565433 dv-cinder-790535-43-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 16 09:49:41.576340 dv-cinder-790535-43-iscsi devstack@n-api.service[127650]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 16 09:49:41.578351 dv-cinder-790535-43-iscsi devstack@n-api.service[127650]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 16 09:49:41 2022] *** Sep 16 09:49:41.578540 dv-cinder-790535-43-iscsi devstack@n-api.service[127650]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 16 09:49:41.578540 dv-cinder-790535-43-iscsi devstack@n-api.service[127650]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 16 09:49:41.578540 dv-cinder-790535-43-iscsi devstack@n-api.service[127650]: nodename: dv-cinder-790535-43-iscsi Sep 16 09:49:41.578540 dv-cinder-790535-43-iscsi devstack@n-api.service[127650]: machine: x86_64 Sep 16 09:49:41.578540 dv-cinder-790535-43-iscsi devstack@n-api.service[127650]: clock source: unix Sep 16 09:49:41.578540 dv-cinder-790535-43-iscsi devstack@n-api.service[127650]: pcre jit disabled Sep 16 09:49:41.578540 dv-cinder-790535-43-iscsi devstack@n-api.service[127650]: detected number of CPU cores: 4 Sep 16 09:49:41.578540 dv-cinder-790535-43-iscsi devstack@n-api.service[127650]: current working directory: / Sep 16 09:49:41.578540 dv-cinder-790535-43-iscsi devstack@n-api.service[127650]: detected binary path: /usr/bin/uwsgi-core Sep 16 09:49:41.578540 dv-cinder-790535-43-iscsi devstack@n-api.service[127650]: your processes number limit is 47680 Sep 16 09:49:41.579231 dv-cinder-790535-43-iscsi devstack@n-api.service[127650]: your memory page size is 4096 bytes Sep 16 09:49:41.579231 dv-cinder-790535-43-iscsi devstack@n-api.service[127650]: detected max file descriptor number: 2048 Sep 16 09:49:41.579231 dv-cinder-790535-43-iscsi devstack@n-api.service[127650]: lock engine: pthread robust mutexes Sep 16 09:49:41.579231 dv-cinder-790535-43-iscsi devstack@n-api.service[127650]: thunder lock: enabled Sep 16 09:49:41.579231 dv-cinder-790535-43-iscsi devstack@n-api.service[127650]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 16 09:49:41.579231 dv-cinder-790535-43-iscsi devstack@n-api.service[127650]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 16 09:49:41.620442 dv-cinder-790535-43-iscsi devstack@n-api.service[127650]: Python main interpreter initialized at 0x5583b1f949c0 Sep 16 09:49:41.620442 dv-cinder-790535-43-iscsi devstack@n-api.service[127650]: python threads support enabled Sep 16 09:49:41.620442 dv-cinder-790535-43-iscsi devstack@n-api.service[127650]: your server socket listen backlog is limited to 100 connections Sep 16 09:49:41.620442 dv-cinder-790535-43-iscsi devstack@n-api.service[127650]: your mercy for graceful operations on workers is 90 seconds Sep 16 09:49:41.620885 dv-cinder-790535-43-iscsi devstack@n-api.service[127650]: mapped 403077 bytes (393 KB) for 2 cores Sep 16 09:49:41.620885 dv-cinder-790535-43-iscsi devstack@n-api.service[127650]: *** Operational MODE: preforking *** Sep 16 09:49:41.621172 dv-cinder-790535-43-iscsi devstack@n-api.service[127650]: *** uWSGI is running in multiple interpreter mode *** Sep 16 09:49:41.621172 dv-cinder-790535-43-iscsi devstack@n-api.service[127650]: spawned uWSGI master process (pid: 127650) Sep 16 09:49:41.621377 dv-cinder-790535-43-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 16 09:49:41.623864 dv-cinder-790535-43-iscsi devstack@n-api.service[127650]: spawned uWSGI worker 1 (pid: 127670, cores: 1) Sep 16 09:49:41.624397 dv-cinder-790535-43-iscsi devstack@n-api.service[127650]: spawned uWSGI worker 2 (pid: 127671, cores: 1) Sep 16 09:49:41.624626 dv-cinder-790535-43-iscsi devstack@n-api.service[127650]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 16 09:49:42.294728 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 16 09:49:42.330473 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 16 09:49:43.466657 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 09:49:43.466657 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: from cryptography.utils import int_from_bytes Sep 16 09:49:43.467241 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 09:49:43.467241 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: from cryptography.utils import int_from_bytes Sep 16 09:49:43.551213 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 09:49:43.551213 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: from cryptography.utils import int_from_bytes Sep 16 09:49:43.552059 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 09:49:43.552059 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: from cryptography.utils import int_from_bytes Sep 16 09:49:45.942126 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 16 09:49:45.942680 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 16 09:49:45.942913 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 16 09:49:45.943288 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 16 09:49:45.943551 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 16 09:49:45.944481 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.944883 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.945280 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.945703 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.946051 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.946372 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.946705 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.947036 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.947372 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.947644 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.947974 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.948446 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-790535-43-iscsi {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.948809 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.949131 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.949472 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.949828 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.950163 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.950497 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.950839 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.951351 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.952113 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.952426 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.952765 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.953295 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.953663 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.953984 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.954316 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.954632 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.954970 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.955287 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.955698 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-790535-43-iscsi {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.956046 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.956353 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.956676 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.957102 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.957422 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.957766 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.958094 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.958425 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.958750 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.959084 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.959437 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.960429 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.960774 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.961084 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.961400 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.961746 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.962076 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.962391 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.962705 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.962964 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.963280 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.963610 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.963938 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.964268 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.964529 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.964791 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.965124 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.965457 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.965797 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.966253 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.966432 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.966750 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.967070 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.967387 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.967698 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.968014 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.968342 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.968663 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.969035 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.969318 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.969686 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.970106 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.73 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.970366 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.73 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.970681 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.971032 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.971406 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.971683 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.972016 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.972347 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.972665 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.972980 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.973396 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.973664 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.974016 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.974329 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.974589 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.974936 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.975463 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.975832 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.976151 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.976697 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.977017 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.977332 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.977692 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.978013 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.978332 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.978650 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.978977 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.979291 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.979609 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.979928 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.980241 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.980554 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.980897 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.981388 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.981739 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.982053 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.982536 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.982852 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.983187 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.983531 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.983846 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.984180 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.984496 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.984810 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.985137 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.985454 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.985815 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.986131 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.986442 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.986758 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.987085 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.987401 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.987719 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.988032 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.988346 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.988659 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.988978 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.989290 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.989640 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.989936 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.990266 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.990597 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.990948 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.991263 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.991575 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.991902 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:45.992252 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:45.992596 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:45.992947 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:45.993268 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:45.993639 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:45.994236 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:45.994562 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:45.994882 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:45.995205 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:45.995538 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:45.995855 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:45.996173 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:45.996491 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:45.996820 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:45.997145 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:45.997481 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:45.997847 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:45.998157 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:45.998481 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:45.998804 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:45.999132 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:45.999476 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:45.999801 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.000122 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.000474 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.000833 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.001154 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.001491 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.001863 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.002183 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.002504 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.002823 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.003177 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.003565 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.003821 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.004151 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.004470 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.004802 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.005123 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.005440 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.005811 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.006101 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.007020 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.007469 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.007801 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.008157 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.008490 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.008849 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.009159 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.009504 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.009870 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.010218 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.010502 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.010819 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.011134 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.011457 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.011773 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.012107 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.012453 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.012770 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.013118 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.013437 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.013785 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.014108 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.014428 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.014745 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.015069 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.015393 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.015706 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.016105 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.016431 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.016746 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.017106 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.017425 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.017854 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.018122 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.018444 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.018771 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.019091 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.019410 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.019750 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.020095 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.020419 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.020786 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.021127 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.021465 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.021873 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.023055 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.023339 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.023739 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.024064 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.024383 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.024748 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.025041 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.025743 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.025743 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.026075 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.026581 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.026743 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.027358 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.027548 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.027731 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.028010 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.028374 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.028673 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.029560 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.029560 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.029896 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.030104 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.030436 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.030771 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.031094 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.031418 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.031740 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.032061 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.032383 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.032704 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.033034 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.033353 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.033708 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.034188 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.034359 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.034673 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.035001 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.035316 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.035644 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.035997 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.036344 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.036669 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.037000 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.037320 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.037701 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.038145 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.038145 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.038792 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.039111 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.039437 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.039755 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.040080 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.040398 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.040736 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.041052 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.041378 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.041717 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.042052 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.042379 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.042718 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.043036 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.043355 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.043686 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.044005 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.044323 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.044640 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.044951 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.045266 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.045611 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.045936 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.046251 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.046565 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.046877 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.047196 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.047514 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.047826 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.048135 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.048452 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.048792 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.049107 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.049442 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.049793 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.050108 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.050422 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.050752 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.051067 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.051410 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.051725 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.052059 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.052417 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.052917 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.053825 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.054159 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.054586 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.054815 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.055552 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.055552 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.056415 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.056415 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.056415 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.057621 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.057621 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.057621 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.057621 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.057931 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.058251 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.058568 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.058916 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.059208 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.059529 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.059844 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.060194 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.060785 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.061127 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.061447 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.061799 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.062155 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.062482 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.062821 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.063157 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.063478 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.063791 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.064110 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.064424 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.064658 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 16 09:49:46.065067 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.065163 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 16 09:49:46.065249 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.065344 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.065438 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 16 09:49:46.065660 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.065857 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 16 09:49:46.066010 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.066177 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 16 09:49:46.066359 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.066578 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.066735 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.066879 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.067051 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.067215 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.067364 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.067541 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.067687 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.067846 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.067998 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.068213 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.068364 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.068516 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.068663 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.068663 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.069570 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.069839 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.070011 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.070390 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.070615 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.070805 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.070978 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.071129 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.071319 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.071466 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-790535-43-iscsi {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.071673 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.071822 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.072003 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.072146 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.072325 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.072480 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.072659 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.072801 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.072994 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.073151 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.073293 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.073440 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.073628 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.073787 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.073961 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.074144 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.074318 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.074461 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.074608 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.074765 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.074917 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.075059 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.075207 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.075357 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.075512 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.075683 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.075839 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.076004 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.076158 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.076332 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.076494 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.076731 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.076887 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.077046 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.077188 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.077328 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.077477 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.077733 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.077897 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-790535-43-iscsi {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.078039 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.078181 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.078340 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.078490 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.078640 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.078789 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.078942 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.079098 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.079240 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.079390 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.079538 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.079679 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.079851 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.080148 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.080298 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.080440 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.080588 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.080738 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.080886 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.081862 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.082030 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.082184 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.082333 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.082477 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.082635 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.082635 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.082928 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.083077 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.083234 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.083376 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.083530 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.083679 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.083834 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.083977 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.084118 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.084266 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.084468 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.084618 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.084819 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.084819 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.085099 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.085247 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.085402 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.085594 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.085747 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.085747 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.086121 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.086268 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.086459 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.086459 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.086948 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.087151 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.087332 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.087520 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.087712 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.087712 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.088079 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.088259 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.088438 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.088626 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.088813 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.089001 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.089180 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.089357 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.089581 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.089773 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.089959 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.090136 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.090321 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.090510 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.090696 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.090874 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.091059 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.091243 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.091429 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.091615 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.091807 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.091993 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.092179 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.092357 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.092534 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.092719 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.092916 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.093093 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.093278 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.73 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.093456 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.093668 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.73 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.093863 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.094041 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.094225 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.094411 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.094607 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.094785 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.094971 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.095168 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.095375 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.095549 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.095737 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.095921 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.096092 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.096255 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.096408 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.096569 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.096727 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.096897 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.097129 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.097284 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.097477 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.097657 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.097811 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.097968 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.098124 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.098282 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.098425 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.098574 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.098722 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.098874 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.099016 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.099165 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.099306 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.099458 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.099607 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.099762 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.099905 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.100088 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.100237 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.100388 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.100530 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.100752 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.100896 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.101047 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.101197 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.101339 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.101491 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.101680 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.101832 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.101973 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.102115 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.102264 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.102418 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.102561 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.102709 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.102851 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.103000 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.103142 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.103142 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.103429 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.103578 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.103720 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.103720 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.103995 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.104146 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.104288 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.104430 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.104578 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.104736 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.104894 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.105044 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.105198 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.105339 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.105488 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.105724 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.105869 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.106017 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.106165 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.106320 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.106463 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.106603 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.106751 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.106900 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.107042 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.107042 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.107437 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.107594 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.107746 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.107896 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.108045 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.108197 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.108340 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.108482 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.108622 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.108763 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.108910 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.109061 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.109213 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.109357 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.109498 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.109672 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.109815 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.109973 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.109973 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.110257 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.110407 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.110549 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.110700 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.110849 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.110999 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.111194 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.111342 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.111485 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.111640 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.111782 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.111931 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.112083 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.112225 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.112365 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.112532 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.112682 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.112823 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.112978 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.113119 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.113265 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.113416 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 09:49:46.113622 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.113622 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.113917 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.114058 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.114212 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.114212 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.114486 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.114629 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.114770 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.114770 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.115077 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.115077 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.115355 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.115496 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.115653 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.116362 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.116520 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.116670 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.116834 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.116986 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.117141 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.117325 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.117586 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.117739 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.117891 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.118042 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.118191 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.118191 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.118477 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.118620 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.118769 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.119162 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.119312 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.119504 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.119675 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.119820 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.119971 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.120121 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.120283 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.120426 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.120605 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.120754 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.120908 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.121051 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.121203 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.121352 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.121502 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.121720 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.121866 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.122016 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.122183 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.122327 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.122469 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.122618 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.122767 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.122911 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.123077 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.123223 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.123373 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.123533 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.123677 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.123828 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.123971 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.124113 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.124261 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.124403 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.124545 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.124740 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.124892 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.125035 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.125177 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.125326 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.125479 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.126254 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.126415 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.126574 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.126725 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.126868 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.127009 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.127160 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.127303 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.127444 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.127709 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.127865 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.128024 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.128192 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.128352 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.128502 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.128650 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.128808 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.128967 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.129115 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.129273 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.129422 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.129622 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.129807 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.129974 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.130124 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.130284 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.130442 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.130442 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.130726 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.130884 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.131047 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.131047 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.131441 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.132146 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.132312 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.132479 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.132643 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.132850 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.133024 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.133174 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.133407 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.133600 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.133757 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.133919 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.134068 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.134225 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.134391 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.134543 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.134690 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.134690 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.134993 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.135160 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.135324 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.135523 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.135692 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.135849 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.136007 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.136167 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.136324 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.136474 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.136624 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.136779 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.136929 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.137096 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.137246 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.137394 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.137598 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.137882 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.137882 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.138198 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.138347 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.138497 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.138646 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.138795 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.138951 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.139120 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.139285 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.139442 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.139591 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.139748 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.139906 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.140056 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.140203 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.140352 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.140499 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.140655 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.140887 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.141046 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.141195 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.141363 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.141513 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.141696 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.141895 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.142054 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.142218 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.142375 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.142525 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.142681 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.142839 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.142999 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.143156 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.143326 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.143483 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.143646 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.143802 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.143953 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.144100 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.144256 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.144413 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.144572 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.144720 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.144876 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.145034 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.145184 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.145350 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.145509 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.145735 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.145885 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.146034 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.146194 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.146194 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.146486 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.146643 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.146792 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.146984 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.147142 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.147306 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.147481 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.147666 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.147822 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.148073 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.148236 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.148395 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.148545 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.148702 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.148851 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.149001 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.149149 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.149308 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.149468 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.149654 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.149820 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.149979 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.150128 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.150288 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.150437 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.150585 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.150741 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.150890 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.151047 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.151205 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.151354 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.151521 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.151678 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.151835 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.151999 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.152149 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.152305 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.152456 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.152604 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.152770 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.152972 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.153132 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.153288 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.153450 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.153644 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.153822 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.153979 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.154136 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.154293 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.154450 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.154599 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.154760 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.154918 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.155074 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.155230 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.155390 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.155538 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.155696 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.155845 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.156002 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.156157 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.156314 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.156476 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.156626 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.156781 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.156938 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.157087 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.157242 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.157495 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.157683 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.157834 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.157983 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.158227 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.158390 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.158558 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.158717 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.158866 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.159021 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.159021 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.159303 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.159461 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.159627 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.159778 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.159933 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.160089 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.160247 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.160397 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.160544 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.160692 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.160847 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.161004 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.161164 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.161314 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.161472 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.161664 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.161818 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.161974 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.162132 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.162282 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.162430 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.162660 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.162914 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.163124 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.163306 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.163514 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.163674 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.163845 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.164007 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.164166 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.164324 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.164474 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.164630 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.164780 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.164929 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.165087 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.165087 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.165371 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.165520 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.165715 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.165881 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.166047 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.166197 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.166345 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.166493 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.166648 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.166798 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.166959 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.167117 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.167267 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.167421 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.167574 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.167746 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.167903 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.168067 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.168242 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.168476 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.168636 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.170211 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.170366 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.170511 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.170653 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.170802 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.170943 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.171096 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.171258 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.171990 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.172149 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.172295 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.172437 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.172669 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.172821 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.172973 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.173122 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.173273 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.173426 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.173599 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.173756 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.175634 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.175797 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.175962 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.176120 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.176266 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.176426 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.176570 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.176719 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.176869 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.177020 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.177165 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.177308 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.177457 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.177635 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.177820 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.180490 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.180851 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.181004 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.181155 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.181300 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.181458 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.181713 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.181891 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.182050 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.182209 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.182371 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.182533 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.182689 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.182901 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.183105 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.183313 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.183642 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.183865 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.184069 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.184265 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.184467 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.184698 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.184898 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.185107 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.185324 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.185528 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.185759 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.185984 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.186178 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.186329 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.186478 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.186631 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.186832 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.186832 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.187227 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.187227 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.187627 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.187823 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.188032 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.188266 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.188476 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.188685 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.188886 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.189093 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.189287 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.189506 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.189725 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.189892 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.190063 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.190275 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.190470 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.190672 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.190885 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.191191 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.191407 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.191632 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.191833 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.192031 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.192236 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.192441 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.192644 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.192865 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.193072 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.193236 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.193401 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.193608 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.193773 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.194670 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.194840 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.194985 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.195128 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.195282 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.195435 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.195578 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.195740 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.195891 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.196044 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.196198 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.196349 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.196502 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.196644 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.196786 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.196941 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.197093 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.197236 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.197379 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.197533 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.197714 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.197869 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.198019 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.198019 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.198306 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.198451 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.198601 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.198601 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.198890 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.199034 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.199183 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.199333 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.199497 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.199642 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.199784 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.199927 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.200069 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.200219 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.200449 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.200602 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.200746 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.200888 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.201043 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.201043 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.201447 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.201663 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.201822 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.201965 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.202114 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.202267 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.202409 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.202552 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.202695 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.202837 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.202986 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.203140 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.203290 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.203444 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.203596 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.203742 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.203891 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.204043 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.204199 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.204356 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.204506 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.204735 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.204903 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.205069 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.205218 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.205377 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.205559 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.205717 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.205891 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.206041 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.206197 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.206346 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.206501 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.206658 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.206825 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.206976 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.207131 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.207280 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.207438 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.207588 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.207750 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.207750 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.208042 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.208042 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.208339 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.208499 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.208649 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.208806 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.208956 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.209104 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.209260 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.209474 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.209665 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.209825 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.209980 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.210132 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.210280 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.210442 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.210600 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.210756 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.210913 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.211063 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.211340 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.211511 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.211680 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.211830 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.211986 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.212143 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.212301 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.212451 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.212599 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.212747 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.212895 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.213050 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.213213 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.213362 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.213528 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.213814 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.213966 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.214123 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.214283 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.214433 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.214582 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.214730 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.214878 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.215036 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.215194 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.215345 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.215494 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.215642 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.215800 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.215959 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.216115 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.216273 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.216430 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.216580 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.216728 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.216890 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.217040 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.217194 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.217351 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.217507 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.217706 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.217874 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.217874 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.218158 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.218307 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.218464 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.218621 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.218781 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.218947 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.219105 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.219262 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.219412 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.219576 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.219743 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.219905 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.220054 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.220203 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.220351 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.220510 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.220668 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.220817 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.220965 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.221135 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.221285 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.221285 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.221736 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.221897 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.222047 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.222204 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.222353 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.222511 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.222670 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.222826 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.222977 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.223133 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.223293 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.223461 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.223614 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.223774 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.223925 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.224074 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.224237 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.224387 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.224536 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.224685 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.224842 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.224991 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.224991 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.225491 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.225755 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.225911 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.226075 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.226243 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.226401 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.226550 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.226711 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.226873 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.226873 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.227165 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.227322 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.227480 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.227640 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.227797 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.227959 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.228120 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.228282 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.228442 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.228600 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.228749 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.228905 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.229063 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.229221 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.229369 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.229518 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.229708 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.229708 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 16 09:49:46.230093 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.230093 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.230093 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.230093 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.230093 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.230093 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.230093 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.230093 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.231233 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.231233 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.231233 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.231233 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.231233 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.231233 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.231233 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.231233 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.232485 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.232485 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.232485 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.232485 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.232485 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.232485 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.232485 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.232485 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.233647 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.233647 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.233647 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.233647 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.233647 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.233647 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.233647 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.233647 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.234816 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.234816 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.234816 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.234816 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.234816 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.234816 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.234816 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.234816 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.235971 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.235971 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.235971 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.235971 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.235971 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.235971 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.235971 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.235971 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.237078 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.237078 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.237078 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.237078 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.237078 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.237078 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.237078 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.237078 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.238246 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.238246 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.238246 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.238246 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.238246 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.238246 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.238246 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.238246 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.239376 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.239376 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.239376 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.239376 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.239932 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.239932 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.240214 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.240361 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.241212 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.241620 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.241928 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.242261 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.242578 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.242913 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.243235 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.243552 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.244121 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.244439 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.244798 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.245116 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.245446 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.245827 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.246169 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.246491 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.246837 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.247177 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.247508 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.247834 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.248173 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.248946 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.248946 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.249328 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.249478 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.249733 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.250050 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.250364 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.251006 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.251310 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.251627 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.252017 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.252278 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.252595 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.252928 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.253690 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.253690 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.254014 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.254198 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.254551 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.254866 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.255204 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.255523 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.255856 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.256184 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.257076 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.257404 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.257750 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.258078 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.258402 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.258723 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.259042 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.259365 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.259689 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.260016 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.260602 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.260945 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.261336 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.261754 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.261961 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.262289 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.262615 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.262940 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.263265 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.263587 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.263909 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.264252 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.265652 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.265652 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.265652 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.265652 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.266641 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.266641 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.266641 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.267083 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.267244 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.267529 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.267856 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.268186 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.268580 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.268827 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.269148 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.269473 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.269835 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.270158 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.270478 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.270809 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.271135 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.273155 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.273155 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.273155 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.273155 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.273155 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.273155 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.274121 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.274121 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.274425 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.275737 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.275737 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.275737 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.275737 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.276384 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.276384 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.276688 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.276849 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.277578 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.277578 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.278115 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.278441 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.278762 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.279092 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.279400 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.279970 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.280330 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.280658 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.280997 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.281341 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.281757 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.282015 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.282356 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.283592 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.283592 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.283592 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.283592 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.284197 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO dbcounter [None req-7915baf1-6483-4048-a4fe-f3924f5456ce None None] Registered counter for database nova_api Sep 16 09:49:46.284353 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.284353 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.284637 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.284841 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.285158 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.285486 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.285826 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.286165 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.286485 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.286803 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.287120 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.287442 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.287793 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.288111 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.288557 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.288728 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.289166 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.289452 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.289802 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.290120 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.290444 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.290817 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.291145 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.291458 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.291890 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.292105 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.292419 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.292752 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.293071 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.293401 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.293890 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.294218 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.294583 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.294914 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.295499 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.295845 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.296174 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.296526 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.296872 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.297201 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.297509 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.297949 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.298288 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.298672 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.298931 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.299317 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.299569 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.299890 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.300204 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.300524 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.300844 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.301163 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.301487 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.301826 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.302266 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.302492 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.302753 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.303082 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.304406 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.304406 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.304963 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.306031 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.306031 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.306031 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.306683 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.306683 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.306683 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.307380 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_db.sqlalchemy.engines [None req-7915baf1-6483-4048-a4fe-f3924f5456ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127671) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 09:49:46.307594 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.307594 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.307917 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.308086 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.308397 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.309320 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.309320 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.309915 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.309915 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.310243 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.310403 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.310814 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.311016 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.311331 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.311647 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.312194 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.312371 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.312676 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.312972 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.313289 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.313629 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.313945 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writer thread running {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 09:49:46.314334 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.314334 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.315400 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.315400 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.315400 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.315841 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.315841 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.316135 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.316381 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.316749 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.317006 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.317317 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.317650 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.317967 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.318279 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.318591 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.319562 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.320075 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.320403 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.320727 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.321046 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.321370 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.321721 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.322723 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.322723 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.322723 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.323219 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.323370 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.323675 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.324194 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.324591 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.324747 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.324957 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.325281 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.326537 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.326537 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.326537 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.327081 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.327081 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.327415 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.327739 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.328085 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.328424 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.328743 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.329081 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.329409 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.329766 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.330092 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.330416 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.330757 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.331079 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.331407 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.331730 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.332051 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.332470 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.332805 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.333128 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.333452 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.333804 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.334134 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.334503 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.334935 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.335451 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.335556 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.335805 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.336168 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.336493 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.336852 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.337192 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.337517 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.337862 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.338178 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 09:49:46.338432 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 16 09:49:46.372018 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.context [None req-7915baf1-6483-4048-a4fe-f3924f5456ce None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6dc1d2d4-28ba-4d76-b176-2388586d08d4(cell1) {{(pid=127671) load_cells /opt/stack/nova/nova/context.py:464}} Sep 16 09:49:46.376064 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7915baf1-6483-4048-a4fe-f3924f5456ce None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:49:46.376539 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7915baf1-6483-4048-a4fe-f3924f5456ce None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:49:46.378140 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7915baf1-6483-4048-a4fe-f3924f5456ce None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:49:46.378884 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7915baf1-6483-4048-a4fe-f3924f5456ce None None] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:49:46.379337 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7915baf1-6483-4048-a4fe-f3924f5456ce None None] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:49:46.381407 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7915baf1-6483-4048-a4fe-f3924f5456ce None None] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:49:46.383970 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO dbcounter [None req-7915baf1-6483-4048-a4fe-f3924f5456ce None None] Registered counter for database nova_cell0 Sep 16 09:49:46.388234 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO dbcounter [None req-7915baf1-6483-4048-a4fe-f3924f5456ce None None] Registered counter for database nova_cell1 Sep 16 09:49:46.396407 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_db.sqlalchemy.engines [None req-7915baf1-6483-4048-a4fe-f3924f5456ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127671) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 09:49:46.397471 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_db.sqlalchemy.engines [None req-7915baf1-6483-4048-a4fe-f3924f5456ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127671) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 09:49:46.402769 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO dbcounter [None req-92a98b39-1ed0-4e53-8865-0222a3a93768 None None] Registered counter for database nova_api Sep 16 09:49:46.404746 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writer thread running {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 09:49:46.406028 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writer thread running {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 09:49:46.423846 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_db.sqlalchemy.engines [None req-92a98b39-1ed0-4e53-8865-0222a3a93768 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127670) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 09:49:46.431489 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writer thread running {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 09:49:46.488315 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.context [None req-92a98b39-1ed0-4e53-8865-0222a3a93768 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6dc1d2d4-28ba-4d76-b176-2388586d08d4(cell1) {{(pid=127670) load_cells /opt/stack/nova/nova/context.py:464}} Sep 16 09:49:46.492965 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-92a98b39-1ed0-4e53-8865-0222a3a93768 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:49:46.493450 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-92a98b39-1ed0-4e53-8865-0222a3a93768 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:49:46.495296 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-92a98b39-1ed0-4e53-8865-0222a3a93768 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:49:46.496046 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-92a98b39-1ed0-4e53-8865-0222a3a93768 None None] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:49:46.496510 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-92a98b39-1ed0-4e53-8865-0222a3a93768 None None] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:49:46.498546 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-92a98b39-1ed0-4e53-8865-0222a3a93768 None None] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:49:46.500550 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO dbcounter [None req-92a98b39-1ed0-4e53-8865-0222a3a93768 None None] Registered counter for database nova_cell0 Sep 16 09:49:46.504635 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO dbcounter [None req-92a98b39-1ed0-4e53-8865-0222a3a93768 None None] Registered counter for database nova_cell1 Sep 16 09:49:46.512107 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_db.sqlalchemy.engines [None req-92a98b39-1ed0-4e53-8865-0222a3a93768 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127670) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 09:49:46.513880 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_db.sqlalchemy.engines [None req-92a98b39-1ed0-4e53-8865-0222a3a93768 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127670) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 09:49:46.520191 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writer thread running {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 09:49:46.521503 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writer thread running {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 09:49:46.556550 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO dbcounter [None req-7915baf1-6483-4048-a4fe-f3924f5456ce None None] Registered counter for database nova_cell0 Sep 16 09:49:46.563359 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_db.sqlalchemy.engines [None req-7915baf1-6483-4048-a4fe-f3924f5456ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127671) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 09:49:46.568168 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writer thread running {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 09:49:46.672120 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO dbcounter [None req-92a98b39-1ed0-4e53-8865-0222a3a93768 None None] Registered counter for database nova_cell0 Sep 16 09:49:46.680113 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_db.sqlalchemy.engines [None req-92a98b39-1ed0-4e53-8865-0222a3a93768 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127670) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 09:49:46.684704 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writer thread running {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 09:49:46.900130 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: WARNING keystonemiddleware.auth_token [None req-7915baf1-6483-4048-a4fe-f3924f5456ce None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 16 09:49:46.908399 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: WARNING keystonemiddleware.auth_token [None req-7915baf1-6483-4048-a4fe-f3924f5456ce None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 16 09:49:47.011639 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: WARNING keystonemiddleware.auth_token [None req-92a98b39-1ed0-4e53-8865-0222a3a93768 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 16 09:49:47.019004 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: WARNING keystonemiddleware.auth_token [None req-92a98b39-1ed0-4e53-8865-0222a3a93768 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 16 09:49:47.254975 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: WARNING keystonemiddleware.auth_token [None req-7915baf1-6483-4048-a4fe-f3924f5456ce None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 16 09:49:47.262473 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: WARNING keystonemiddleware.auth_token [None req-7915baf1-6483-4048-a4fe-f3924f5456ce None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 16 09:49:47.267908 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5583b1f949c0 pid: 127671 (default app) Sep 16 09:49:47.367992 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: WARNING keystonemiddleware.auth_token [None req-92a98b39-1ed0-4e53-8865-0222a3a93768 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 16 09:49:47.374395 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: WARNING keystonemiddleware.auth_token [None req-92a98b39-1ed0-4e53-8865-0222a3a93768 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 16 09:49:47.379708 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5583b1f949c0 pid: 127670 (default app) Sep 16 09:50:26.249342 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_api:SELECT=3 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:50:26.250658 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell0:SELECT=3 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:50:26.251470 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell1:SELECT=3 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:50:26.252500 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell0:SELECT=3 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:50:26.392303 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_api:SELECT=3 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:50:26.394125 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=3 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:50:26.395124 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell0:SELECT=3 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:50:26.396278 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell0:SELECT=3 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:50:27.281285 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-431379c6-42fa-46a6-ad20-62a35104d246 tempest-VolumesGetTestJSON-805888 tempest-VolumesGetTestJSON-805888-project] Action: 'create', calling method: .version_select at 0x7ffa6eba5430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1615407192", "metadata": {"Type": "work"}}} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:50:27.664154 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-a6fa633c-5ea0-4822-8f28-2ef865891d61 tempest-VolumesNegativeTest-508182641 tempest-VolumesNegativeTest-508182641-project] Action: 'create', calling method: .version_select at 0x7ffa6eba4430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-155340066", "metadata": {"Type": "work"}}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:50:27.664154 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-a6fa633c-5ea0-4822-8f28-2ef865891d61 tempest-VolumesNegativeTest-508182641 tempest-VolumesNegativeTest-508182641-project] Request method failure captured: Sep 16 09:50:27.664154 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 16 09:50:27.664154 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept: application/json Sep 16 09:50:27.664154 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Sep 16 09:50:27.664154 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Connection: close Sep 16 09:50:27.664154 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Length: 121 Sep 16 09:50:27.664154 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Type: application/json Sep 16 09:50:27.664154 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Host: 10.222.0.73 Sep 16 09:50:27.664154 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Sep 16 09:50:27.664154 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Sep 16 09:50:27.664154 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjJEbi5Cf0lrM0TK3V4I88_st4k5t5oEM2Kh-i2AZ8ndVIP_zmm43h79MJ_BSFOwcEFMXxwWl5FOHKq1elJd4jFteAN_KseFe1Ew5QszME3-R0GdFR_vp4xZi7na3gB9bR70Nandg4qDVRCF4DZRA_hZYJed-CNQPAcJDQZcRM0YKyb3Q Sep 16 09:50:27.664154 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Sep 16 09:50:27.664154 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Sep 16 09:50:27.664154 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Sep 16 09:50:27.664154 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Sep 16 09:50:27.664154 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Sep 16 09:50:27.664154 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Sep 16 09:50:27.664154 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Id: 0756d3c1dfbb4ebc9aa3dc5e29c69ed9 Sep 16 09:50:27.664154 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-VolumesNegativeTest-508182641 Sep 16 09:50:27.664154 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Role: reader,member Sep 16 09:50:27.664154 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Roles: reader,member Sep 16 09:50:27.668709 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0756d3c1dfbb4ebc9aa3dc5e29c69ed9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_0756d3c1dfbb4ebc9aa3dc5e29c69ed9", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0756d3c1dfbb4ebc9aa3dc5e29c69ed9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/0756d3c1dfbb4ebc9aa3dc5e29c69ed9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 09:50:27.668709 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-VolumesNegativeTest-508182641 Sep 16 09:50:27.668709 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Id: 0756d3c1dfbb4ebc9aa3dc5e29c69ed9 Sep 16 09:50:27.668709 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-VolumesNegativeTest-508182641 Sep 16 09:50:27.668709 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User: tempest-VolumesNegativeTest-508182641-project Sep 16 09:50:27.668709 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Sep 16 09:50:27.668709 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Sep 16 09:50:27.668709 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Id: 8841a9d894cb47ac91de4de6fcc4da8a Sep 16 09:50:27.668709 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-VolumesNegativeTest-508182641-project Sep 16 09:50:27.668709 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Sep 16 09:50:27.668709 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-155340066", "metadata": {"Type": "work"}}} Sep 16 09:50:27.668709 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: method: Sep 16 09:50:27.668709 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 16 09:50:27.673637 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-155340066', 'metadata': {'Type': 'work'}}}} Sep 16 09:50:27.673637 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 09:50:27.673637 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:50:27.673637 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 09:50:27.673637 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 09:50:27.673637 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 09:50:27.673637 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise error Sep 16 09:50:27.673637 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 16 09:50:27.673637 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:50:27.673637 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 16 09:50:27.673637 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 16 09:50:27.673637 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:50:27.673637 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 16 09:50:27.673637 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi '#$%' Sep 16 09:50:27.673637 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:50:27.673637 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:50:27.673637 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:50:27.673637 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:50:27.673637 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:50:27.673637 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:50:27.673637 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 09:50:27.673637 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 09:50:27.677502 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 09:50:27.677502 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 09:50:27.677502 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 09:50:27.677502 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:50:27.677502 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 09:50:27.677502 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 09:50:27.677502 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 09:50:27.677502 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 09:50:27.677502 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 09:50:27.677502 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 09:50:27.677502 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 16 09:50:27.677502 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:50:27.677502 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:50:27.677502 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:50:27.677502 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:50:27.677502 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:50:27.677502 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:50:27.677502 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 09:50:27.677502 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 09:50:27.681733 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 16 09:50:27.681733 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:50:27.681733 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-a6fa633c-5ea0-4822-8f28-2ef865891d61 tempest-VolumesNegativeTest-508182641 tempest-VolumesNegativeTest-508182641-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 09:50:27.681733 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-a6fa633c-5ea0-4822-8f28-2ef865891d61 tempest-VolumesNegativeTest-508182641 tempest-VolumesNegativeTest-508182641-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.061704 Sep 16 09:50:27.681733 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 1/1] 10.222.0.73 () {60 vars in 1156 bytes} [Fri Sep 16 09:50:26 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1064 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 09:50:27.681733 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-3ff82334-22c3-457c-b50e-a48db94f9811 tempest-VolumesNegativeTest-508182641 tempest-VolumesNegativeTest-508182641-project] Action: 'create', calling method: .version_select at 0x7ffa6eba4d30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-716521293", "metadata": {"Type": "work"}}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:50:27.681733 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-3ff82334-22c3-457c-b50e-a48db94f9811 tempest-VolumesNegativeTest-508182641 tempest-VolumesNegativeTest-508182641-project] Request method failure captured: Sep 16 09:50:27.681733 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 16 09:50:27.681733 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept: application/json Sep 16 09:50:27.683651 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Sep 16 09:50:27.683651 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Connection: close Sep 16 09:50:27.683651 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Length: 119 Sep 16 09:50:27.683651 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Type: application/json Sep 16 09:50:27.683651 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Host: 10.222.0.73 Sep 16 09:50:27.683651 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Sep 16 09:50:27.683651 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Sep 16 09:50:27.683651 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjJEbi5Cf0lrM0TK3V4I88_st4k5t5oEM2Kh-i2AZ8ndVIP_zmm43h79MJ_BSFOwcEFMXxwWl5FOHKq1elJd4jFteAN_KseFe1Ew5QszME3-R0GdFR_vp4xZi7na3gB9bR70Nandg4qDVRCF4DZRA_hZYJed-CNQPAcJDQZcRM0YKyb3Q Sep 16 09:50:27.683651 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Sep 16 09:50:27.683651 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Sep 16 09:50:27.683651 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Sep 16 09:50:27.683651 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Sep 16 09:50:27.683651 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Sep 16 09:50:27.683651 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Sep 16 09:50:27.683651 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Id: 0756d3c1dfbb4ebc9aa3dc5e29c69ed9 Sep 16 09:50:27.683651 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-VolumesNegativeTest-508182641 Sep 16 09:50:27.683651 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Role: reader,member Sep 16 09:50:27.683651 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Roles: reader,member Sep 16 09:50:27.683651 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0756d3c1dfbb4ebc9aa3dc5e29c69ed9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_0756d3c1dfbb4ebc9aa3dc5e29c69ed9", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0756d3c1dfbb4ebc9aa3dc5e29c69ed9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/0756d3c1dfbb4ebc9aa3dc5e29c69ed9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 09:50:27.685436 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-VolumesNegativeTest-508182641 Sep 16 09:50:27.685436 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Id: 0756d3c1dfbb4ebc9aa3dc5e29c69ed9 Sep 16 09:50:27.685436 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-VolumesNegativeTest-508182641 Sep 16 09:50:27.685436 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User: tempest-VolumesNegativeTest-508182641-project Sep 16 09:50:27.685436 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Sep 16 09:50:27.685436 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Sep 16 09:50:27.685436 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Id: 8841a9d894cb47ac91de4de6fcc4da8a Sep 16 09:50:27.685436 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-VolumesNegativeTest-508182641-project Sep 16 09:50:27.685436 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Sep 16 09:50:27.685436 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-716521293", "metadata": {"Type": "work"}}} Sep 16 09:50:27.685436 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: method: Sep 16 09:50:27.685436 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 16 09:50:27.685436 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-716521293', 'metadata': {'Type': 'work'}}}} Sep 16 09:50:27.685436 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 09:50:27.685436 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:50:27.685436 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 09:50:27.685436 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 09:50:27.685436 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 09:50:27.685436 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise error Sep 16 09:50:27.685436 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 16 09:50:27.685436 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:50:27.685436 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 16 09:50:27.685436 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 16 09:50:27.685436 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:50:27.685436 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 16 09:50:27.685436 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi '0' Sep 16 09:50:27.685436 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:50:27.688562 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:50:27.688562 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:50:27.688562 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:50:27.688562 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:50:27.688562 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:50:27.688562 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 09:50:27.688562 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 09:50:27.688562 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 09:50:27.688562 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 09:50:27.688562 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 09:50:27.688562 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:50:27.688562 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 09:50:27.688562 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 09:50:27.688562 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 09:50:27.688562 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 09:50:27.688562 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 09:50:27.688562 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 09:50:27.688562 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 16 09:50:27.688562 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:50:27.688562 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:50:27.691830 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:50:27.691830 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:50:27.691830 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:50:27.691830 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:50:27.691830 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 09:50:27.691830 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 09:50:27.691830 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 16 09:50:27.691830 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:50:27.691830 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-3ff82334-22c3-457c-b50e-a48db94f9811 tempest-VolumesNegativeTest-508182641 tempest-VolumesNegativeTest-508182641-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 09:50:27.691830 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-3ff82334-22c3-457c-b50e-a48db94f9811 tempest-VolumesNegativeTest-508182641 tempest-VolumesNegativeTest-508182641-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.017192 Sep 16 09:50:27.691830 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 2/2] 10.222.0.73 () {60 vars in 1156 bytes} [Fri Sep 16 09:50:27 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 09:50:27.693861 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-0b934227-8f0b-440b-a7ca-ad2018169f6e tempest-VolumesNegativeTest-508182641 tempest-VolumesNegativeTest-508182641-project] Action: 'create', calling method: .version_select at 0x7ffa6ea60160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1008711439", "metadata": {"Type": "work"}}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:50:27.693861 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-0b934227-8f0b-440b-a7ca-ad2018169f6e tempest-VolumesNegativeTest-508182641 tempest-VolumesNegativeTest-508182641-project] Request method failure captured: Sep 16 09:50:27.693861 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 16 09:50:27.693861 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept: application/json Sep 16 09:50:27.693861 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Sep 16 09:50:27.693861 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Connection: close Sep 16 09:50:27.693861 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Length: 119 Sep 16 09:50:27.693861 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Type: application/json Sep 16 09:50:27.693861 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Host: 10.222.0.73 Sep 16 09:50:27.693861 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Sep 16 09:50:27.693861 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Sep 16 09:50:27.693861 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjJEbi5Cf0lrM0TK3V4I88_st4k5t5oEM2Kh-i2AZ8ndVIP_zmm43h79MJ_BSFOwcEFMXxwWl5FOHKq1elJd4jFteAN_KseFe1Ew5QszME3-R0GdFR_vp4xZi7na3gB9bR70Nandg4qDVRCF4DZRA_hZYJed-CNQPAcJDQZcRM0YKyb3Q Sep 16 09:50:27.693861 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Sep 16 09:50:27.693861 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Sep 16 09:50:27.693861 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Sep 16 09:50:27.693861 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Sep 16 09:50:27.693861 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Sep 16 09:50:27.693861 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Sep 16 09:50:27.693861 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Id: 0756d3c1dfbb4ebc9aa3dc5e29c69ed9 Sep 16 09:50:27.693861 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-VolumesNegativeTest-508182641 Sep 16 09:50:27.693861 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Role: reader,member Sep 16 09:50:27.693861 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Roles: reader,member Sep 16 09:50:27.694995 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0756d3c1dfbb4ebc9aa3dc5e29c69ed9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_0756d3c1dfbb4ebc9aa3dc5e29c69ed9", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0756d3c1dfbb4ebc9aa3dc5e29c69ed9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/0756d3c1dfbb4ebc9aa3dc5e29c69ed9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 09:50:27.694995 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-VolumesNegativeTest-508182641 Sep 16 09:50:27.694995 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Id: 0756d3c1dfbb4ebc9aa3dc5e29c69ed9 Sep 16 09:50:27.694995 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-VolumesNegativeTest-508182641 Sep 16 09:50:27.694995 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User: tempest-VolumesNegativeTest-508182641-project Sep 16 09:50:27.694995 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Sep 16 09:50:27.694995 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Sep 16 09:50:27.694995 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Id: 8841a9d894cb47ac91de4de6fcc4da8a Sep 16 09:50:27.694995 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-VolumesNegativeTest-508182641-project Sep 16 09:50:27.694995 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Sep 16 09:50:27.694995 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1008711439", "metadata": {"Type": "work"}}} Sep 16 09:50:27.694995 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: method: Sep 16 09:50:27.694995 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 16 09:50:27.695704 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1008711439', 'metadata': {'Type': 'work'}}}} Sep 16 09:50:27.695704 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 09:50:27.695704 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:50:27.695704 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 09:50:27.695704 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 09:50:27.695704 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 09:50:27.695704 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise error Sep 16 09:50:27.695704 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 16 09:50:27.695704 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:50:27.695704 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 16 09:50:27.695704 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 16 09:50:27.695704 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:50:27.695704 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 16 09:50:27.695704 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi '' Sep 16 09:50:27.695704 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:50:27.695704 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:50:27.695704 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:50:27.695704 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:50:27.695704 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:50:27.695704 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:50:27.695704 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 09:50:27.695704 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 09:50:27.696951 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 09:50:27.696951 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 09:50:27.696951 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 09:50:27.696951 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:50:27.696951 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 09:50:27.696951 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 09:50:27.696951 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 09:50:27.696951 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 09:50:27.696951 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 09:50:27.696951 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 09:50:27.696951 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 16 09:50:27.696951 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:50:27.696951 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:50:27.696951 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:50:27.696951 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:50:27.696951 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:50:27.696951 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:50:27.696951 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 09:50:27.696951 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 09:50:27.698144 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 16 09:50:27.698144 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:50:27.698144 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-0b934227-8f0b-440b-a7ca-ad2018169f6e tempest-VolumesNegativeTest-508182641 tempest-VolumesNegativeTest-508182641-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 09:50:27.698144 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-0b934227-8f0b-440b-a7ca-ad2018169f6e tempest-VolumesNegativeTest-508182641 tempest-VolumesNegativeTest-508182641-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009290 Sep 16 09:50:27.698144 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 3/3] 10.222.0.73 () {60 vars in 1156 bytes} [Fri Sep 16 09:50:27 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 09:50:27.698144 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-b5363ff3-2a3b-4d6a-a2e4-e18d2ddd3268 tempest-VolumesNegativeTest-508182641 tempest-VolumesNegativeTest-508182641-project] Calling method '.version_select at 0x7ffa6ea60c10>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:50:28.632697 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.wsgi [None req-b5363ff3-2a3b-4d6a-a2e4-e18d2ddd3268 tempest-VolumesNegativeTest-508182641 tempest-VolumesNegativeTest-508182641-project] HTTP exception thrown: Volume tempest-invalid-2078304879 could not be found. Sep 16 09:50:28.641906 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-b5363ff3-2a3b-4d6a-a2e4-e18d2ddd3268 tempest-VolumesNegativeTest-508182641 tempest-VolumesNegativeTest-508182641-project] Request method failure captured: Sep 16 09:50:28.641906 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2078304879 HTTP/1.1 Sep 16 09:50:28.641906 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept: application/json Sep 16 09:50:28.641906 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Sep 16 09:50:28.641906 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Connection: close Sep 16 09:50:28.641906 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Length: 0 Sep 16 09:50:28.641906 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Type: application/json Sep 16 09:50:28.641906 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Host: 10.222.0.73 Sep 16 09:50:28.641906 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Sep 16 09:50:28.641906 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Sep 16 09:50:28.641906 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjJEbi5Cf0lrM0TK3V4I88_st4k5t5oEM2Kh-i2AZ8ndVIP_zmm43h79MJ_BSFOwcEFMXxwWl5FOHKq1elJd4jFteAN_KseFe1Ew5QszME3-R0GdFR_vp4xZi7na3gB9bR70Nandg4qDVRCF4DZRA_hZYJed-CNQPAcJDQZcRM0YKyb3Q Sep 16 09:50:28.641906 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Sep 16 09:50:28.641906 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Sep 16 09:50:28.641906 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Sep 16 09:50:28.641906 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Sep 16 09:50:28.641906 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Sep 16 09:50:28.641906 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Sep 16 09:50:28.641906 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Id: 0756d3c1dfbb4ebc9aa3dc5e29c69ed9 Sep 16 09:50:28.641906 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-VolumesNegativeTest-508182641 Sep 16 09:50:28.641906 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Role: reader,member Sep 16 09:50:28.641906 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Roles: reader,member Sep 16 09:50:28.643240 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0756d3c1dfbb4ebc9aa3dc5e29c69ed9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_0756d3c1dfbb4ebc9aa3dc5e29c69ed9", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0756d3c1dfbb4ebc9aa3dc5e29c69ed9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/0756d3c1dfbb4ebc9aa3dc5e29c69ed9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 09:50:28.643240 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-VolumesNegativeTest-508182641 Sep 16 09:50:28.643240 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Id: 0756d3c1dfbb4ebc9aa3dc5e29c69ed9 Sep 16 09:50:28.643240 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-VolumesNegativeTest-508182641 Sep 16 09:50:28.643240 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User: tempest-VolumesNegativeTest-508182641-project Sep 16 09:50:28.643240 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Sep 16 09:50:28.643240 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Sep 16 09:50:28.643240 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Id: 8841a9d894cb47ac91de4de6fcc4da8a Sep 16 09:50:28.643240 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-VolumesNegativeTest-508182641-project Sep 16 09:50:28.643240 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: method: Sep 16 09:50:28.643240 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: exception: Volume tempest-invalid-2078304879 could not be found. Sep 16 09:50:28.643240 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: action_args: {'id': 'tempest-invalid-2078304879'} Sep 16 09:50:28.643240 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 09:50:28.644155 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:50:28.644155 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 09:50:28.644155 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 09:50:28.644155 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 16 09:50:28.644155 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 16 09:50:28.644155 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 16 09:50:28.644155 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 16 09:50:28.644155 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 16 09:50:28.644155 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 16 09:50:28.644155 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 16 09:50:28.644155 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 16 09:50:28.644155 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 09:50:28.644155 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 09:50:28.644155 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 09:50:28.644155 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 09:50:28.644155 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2078304879 could not be found. (HTTP 404) (Request-ID: req-725a6bde-1fda-4954-8135-3b992a862d48) Sep 16 09:50:28.644155 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:50:28.644155 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:50:28.644155 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:50:28.645728 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:50:28.645728 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 16 09:50:28.645728 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 16 09:50:28.645728 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 16 09:50:28.645728 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 16 09:50:28.645728 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 16 09:50:28.645728 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 16 09:50:28.645728 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 16 09:50:28.645728 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 16 09:50:28.645728 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 09:50:28.645728 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 09:50:28.645728 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 16 09:50:28.645728 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 16 09:50:28.645728 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 16 09:50:28.645728 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 16 09:50:28.645728 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 16 09:50:28.645728 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 16 09:50:28.645728 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 16 09:50:28.645728 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 16 09:50:28.649468 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 09:50:28.649468 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 09:50:28.649468 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 09:50:28.649468 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 09:50:28.649468 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2078304879 could not be found. Sep 16 09:50:28.649468 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:50:28.649468 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:50:28.649468 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:50:28.649468 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:50:28.649468 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:50:28.649468 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:50:28.649468 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 09:50:28.649468 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 09:50:28.649468 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 09:50:28.649468 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 09:50:28.649468 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 09:50:28.649468 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:50:28.649468 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 16 09:50:28.649468 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 09:50:28.649468 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2078304879 could not be found. Sep 16 09:50:28.651609 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:50:28.651609 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:50:28.651609 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:50:28.651609 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:50:28.651609 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:50:28.651609 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:50:28.651609 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 09:50:28.651609 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 09:50:28.651609 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2078304879 could not be found. Sep 16 09:50:28.651609 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:50:28.651609 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-b5363ff3-2a3b-4d6a-a2e4-e18d2ddd3268 tempest-VolumesNegativeTest-508182641 tempest-VolumesNegativeTest-508182641-project] Returning 404 to user: Volume tempest-invalid-2078304879 could not be found. {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 09:50:28.651609 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-b5363ff3-2a3b-4d6a-a2e4-e18d2ddd3268 tempest-VolumesNegativeTest-508182641 tempest-VolumesNegativeTest-508182641-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2078304879" status: 404 len: 99 microversion: 2.1 time: 1.153478 Sep 16 09:50:28.655316 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 4/4] 10.222.0.73 () {58 vars in 1218 bytes} [Fri Sep 16 09:50:27 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2078304879 => generated 99 bytes in 1164 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 16 09:50:28.668923 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-95df6ce4-a3c7-49ca-9e09-693a3f08855f tempest-VolumesNegativeTest-508182641 tempest-VolumesNegativeTest-508182641-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.013623 Sep 16 09:50:28.669518 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 5/5] 10.222.0.73 () {58 vars in 1140 bytes} [Fri Sep 16 09:50:28 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 16 09:50:28.684478 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-8381a120-01b3-4223-b2ae-75bcd68c74c7 tempest-VolumesNegativeTest-508182641 tempest-VolumesNegativeTest-508182641-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009487 Sep 16 09:50:28.687071 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 6/6] 10.222.0.73 () {58 vars in 1137 bytes} [Fri Sep 16 09:50:28 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 16 09:50:28.717128 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-aefae325-2172-4e16-96ab-94973beaece5 tempest-VolumesNegativeTest-508182641 tempest-VolumesNegativeTest-508182641-project] Calling method '.version_select at 0x7ffa6e9943a0>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:50:28.789406 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.wsgi [None req-aefae325-2172-4e16-96ab-94973beaece5 tempest-VolumesNegativeTest-508182641 tempest-VolumesNegativeTest-508182641-project] HTTP exception thrown: Volume f1c3fed3-4d15-4116-8083-19611f737195 could not be found. Sep 16 09:50:28.791680 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-aefae325-2172-4e16-96ab-94973beaece5 tempest-VolumesNegativeTest-508182641 tempest-VolumesNegativeTest-508182641-project] Request method failure captured: Sep 16 09:50:28.791680 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: request: DELETE /compute/v2.1/os-volumes/f1c3fed3-4d15-4116-8083-19611f737195 HTTP/1.1 Sep 16 09:50:28.791680 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept: application/json Sep 16 09:50:28.791680 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Sep 16 09:50:28.791680 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Connection: close Sep 16 09:50:28.791680 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Length: 0 Sep 16 09:50:28.791680 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Type: application/json Sep 16 09:50:28.791680 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Host: 10.222.0.73 Sep 16 09:50:28.791680 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Sep 16 09:50:28.791680 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Sep 16 09:50:28.791680 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjJEbi5Cf0lrM0TK3V4I88_st4k5t5oEM2Kh-i2AZ8ndVIP_zmm43h79MJ_BSFOwcEFMXxwWl5FOHKq1elJd4jFteAN_KseFe1Ew5QszME3-R0GdFR_vp4xZi7na3gB9bR70Nandg4qDVRCF4DZRA_hZYJed-CNQPAcJDQZcRM0YKyb3Q Sep 16 09:50:28.791680 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Sep 16 09:50:28.791680 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Sep 16 09:50:28.791680 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Sep 16 09:50:28.791680 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Sep 16 09:50:28.791680 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Sep 16 09:50:28.791680 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Sep 16 09:50:28.791680 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Id: 0756d3c1dfbb4ebc9aa3dc5e29c69ed9 Sep 16 09:50:28.791680 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-VolumesNegativeTest-508182641 Sep 16 09:50:28.791680 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Role: reader,member Sep 16 09:50:28.791680 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Roles: reader,member Sep 16 09:50:28.792888 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0756d3c1dfbb4ebc9aa3dc5e29c69ed9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_0756d3c1dfbb4ebc9aa3dc5e29c69ed9", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0756d3c1dfbb4ebc9aa3dc5e29c69ed9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/0756d3c1dfbb4ebc9aa3dc5e29c69ed9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 09:50:28.792888 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-VolumesNegativeTest-508182641 Sep 16 09:50:28.792888 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Id: 0756d3c1dfbb4ebc9aa3dc5e29c69ed9 Sep 16 09:50:28.792888 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-VolumesNegativeTest-508182641 Sep 16 09:50:28.792888 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User: tempest-VolumesNegativeTest-508182641-project Sep 16 09:50:28.792888 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Sep 16 09:50:28.792888 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Sep 16 09:50:28.792888 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Id: 8841a9d894cb47ac91de4de6fcc4da8a Sep 16 09:50:28.792888 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-VolumesNegativeTest-508182641-project Sep 16 09:50:28.792888 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: method: Sep 16 09:50:28.792888 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: exception: Volume f1c3fed3-4d15-4116-8083-19611f737195 could not be found. Sep 16 09:50:28.792888 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: action_args: {'id': 'f1c3fed3-4d15-4116-8083-19611f737195'} Sep 16 09:50:28.792888 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 09:50:28.793762 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:50:28.793762 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 09:50:28.793762 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 09:50:28.793762 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 16 09:50:28.793762 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 16 09:50:28.793762 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 16 09:50:28.793762 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 16 09:50:28.793762 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 16 09:50:28.793762 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 16 09:50:28.793762 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 16 09:50:28.793762 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 16 09:50:28.793762 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 09:50:28.793762 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 09:50:28.793762 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 09:50:28.793762 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 09:50:28.793762 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f1c3fed3-4d15-4116-8083-19611f737195 could not be found. (HTTP 404) (Request-ID: req-c4138005-5aad-4b82-8757-654e3ae53b4f) Sep 16 09:50:28.793762 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:50:28.793762 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:50:28.793762 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:50:28.794923 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:50:28.794923 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 16 09:50:28.794923 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 16 09:50:28.794923 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 16 09:50:28.794923 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 16 09:50:28.794923 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 16 09:50:28.794923 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 16 09:50:28.794923 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 16 09:50:28.794923 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 16 09:50:28.794923 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 09:50:28.794923 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 09:50:28.794923 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 16 09:50:28.794923 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 16 09:50:28.794923 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 16 09:50:28.794923 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 16 09:50:28.794923 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 16 09:50:28.794923 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 16 09:50:28.794923 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 16 09:50:28.794923 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 16 09:50:28.795815 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 09:50:28.795815 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 09:50:28.795815 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 09:50:28.795815 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 09:50:28.795815 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f1c3fed3-4d15-4116-8083-19611f737195 could not be found. Sep 16 09:50:28.795815 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:50:28.795815 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:50:28.795815 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:50:28.795815 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:50:28.795815 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:50:28.795815 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:50:28.795815 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 09:50:28.795815 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 09:50:28.795815 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 09:50:28.795815 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 09:50:28.795815 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 09:50:28.795815 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:50:28.795815 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 16 09:50:28.795815 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 09:50:28.796682 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f1c3fed3-4d15-4116-8083-19611f737195 could not be found. Sep 16 09:50:28.796682 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:50:28.796682 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:50:28.796682 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:50:28.796682 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:50:28.796682 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:50:28.796682 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:50:28.796682 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 09:50:28.796682 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 09:50:28.796682 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f1c3fed3-4d15-4116-8083-19611f737195 could not be found. Sep 16 09:50:28.796682 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:50:28.796682 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-aefae325-2172-4e16-96ab-94973beaece5 tempest-VolumesNegativeTest-508182641 tempest-VolumesNegativeTest-508182641-project] Returning 404 to user: Volume f1c3fed3-4d15-4116-8083-19611f737195 could not be found. {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 09:50:28.796682 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-aefae325-2172-4e16-96ab-94973beaece5 tempest-VolumesNegativeTest-508182641 tempest-VolumesNegativeTest-508182641-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/f1c3fed3-4d15-4116-8083-19611f737195" status: 404 len: 109 microversion: 2.1 time: 0.101599 Sep 16 09:50:28.796682 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 7/7] 10.222.0.73 () {58 vars in 1248 bytes} [Fri Sep 16 09:50:28 2022] DELETE /compute/v2.1/os-volumes/f1c3fed3-4d15-4116-8083-19611f737195 => generated 109 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 09:50:28.805426 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-68d8022a-3357-4ed5-98d6-e7ba106b4f33 tempest-VolumesNegativeTest-508182641 tempest-VolumesNegativeTest-508182641-project] Calling method '.version_select at 0x7ffa6e994280>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:50:28.837930 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.wsgi [None req-68d8022a-3357-4ed5-98d6-e7ba106b4f33 tempest-VolumesNegativeTest-508182641 tempest-VolumesNegativeTest-508182641-project] HTTP exception thrown: Volume 83562849-a9fe-40c8-882d-7f952b49f025 could not be found. Sep 16 09:50:28.839962 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-68d8022a-3357-4ed5-98d6-e7ba106b4f33 tempest-VolumesNegativeTest-508182641 tempest-VolumesNegativeTest-508182641-project] Request method failure captured: Sep 16 09:50:28.839962 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: request: GET /compute/v2.1/os-volumes/83562849-a9fe-40c8-882d-7f952b49f025 HTTP/1.1 Sep 16 09:50:28.839962 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept: application/json Sep 16 09:50:28.839962 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Sep 16 09:50:28.839962 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Connection: close Sep 16 09:50:28.839962 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Length: 0 Sep 16 09:50:28.839962 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Type: application/json Sep 16 09:50:28.839962 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Host: 10.222.0.73 Sep 16 09:50:28.839962 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Sep 16 09:50:28.839962 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Sep 16 09:50:28.839962 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjJEbi5Cf0lrM0TK3V4I88_st4k5t5oEM2Kh-i2AZ8ndVIP_zmm43h79MJ_BSFOwcEFMXxwWl5FOHKq1elJd4jFteAN_KseFe1Ew5QszME3-R0GdFR_vp4xZi7na3gB9bR70Nandg4qDVRCF4DZRA_hZYJed-CNQPAcJDQZcRM0YKyb3Q Sep 16 09:50:28.839962 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Sep 16 09:50:28.839962 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Sep 16 09:50:28.839962 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Sep 16 09:50:28.839962 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Sep 16 09:50:28.839962 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Sep 16 09:50:28.839962 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Sep 16 09:50:28.839962 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Id: 0756d3c1dfbb4ebc9aa3dc5e29c69ed9 Sep 16 09:50:28.839962 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-VolumesNegativeTest-508182641 Sep 16 09:50:28.839962 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Role: reader,member Sep 16 09:50:28.839962 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Roles: reader,member Sep 16 09:50:28.841168 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0756d3c1dfbb4ebc9aa3dc5e29c69ed9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_0756d3c1dfbb4ebc9aa3dc5e29c69ed9", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0756d3c1dfbb4ebc9aa3dc5e29c69ed9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/0756d3c1dfbb4ebc9aa3dc5e29c69ed9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 09:50:28.841168 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-VolumesNegativeTest-508182641 Sep 16 09:50:28.841168 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Id: 0756d3c1dfbb4ebc9aa3dc5e29c69ed9 Sep 16 09:50:28.841168 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-VolumesNegativeTest-508182641 Sep 16 09:50:28.841168 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User: tempest-VolumesNegativeTest-508182641-project Sep 16 09:50:28.841168 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Sep 16 09:50:28.841168 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Sep 16 09:50:28.841168 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Id: 8841a9d894cb47ac91de4de6fcc4da8a Sep 16 09:50:28.841168 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-VolumesNegativeTest-508182641-project Sep 16 09:50:28.841168 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: method: Sep 16 09:50:28.841168 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: exception: Volume 83562849-a9fe-40c8-882d-7f952b49f025 could not be found. Sep 16 09:50:28.841168 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: action_args: {'id': '83562849-a9fe-40c8-882d-7f952b49f025'} Sep 16 09:50:28.841168 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 09:50:28.841967 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:50:28.841967 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 09:50:28.841967 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 09:50:28.841967 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 16 09:50:28.841967 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 16 09:50:28.841967 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 16 09:50:28.841967 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 16 09:50:28.841967 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 09:50:28.841967 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 09:50:28.841967 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 09:50:28.841967 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 09:50:28.841967 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 09:50:28.841967 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 09:50:28.841967 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 09:50:28.841967 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 09:50:28.841967 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 83562849-a9fe-40c8-882d-7f952b49f025 could not be found. (HTTP 404) (Request-ID: req-729d0ade-4a11-40ee-b0d3-14b5af3af0fa) Sep 16 09:50:28.841967 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:50:28.841967 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:50:28.841967 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:50:28.842897 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:50:28.842897 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 16 09:50:28.842897 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 16 09:50:28.842897 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 16 09:50:28.842897 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 16 09:50:28.842897 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 16 09:50:28.842897 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 16 09:50:28.842897 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 16 09:50:28.842897 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 16 09:50:28.842897 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 09:50:28.842897 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 09:50:28.842897 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 16 09:50:28.842897 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 16 09:50:28.842897 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 16 09:50:28.842897 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 16 09:50:28.842897 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 09:50:28.842897 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 09:50:28.842897 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 09:50:28.842897 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 09:50:28.843806 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 09:50:28.843806 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 09:50:28.843806 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 09:50:28.843806 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 09:50:28.843806 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 83562849-a9fe-40c8-882d-7f952b49f025 could not be found. Sep 16 09:50:28.843806 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:50:28.843806 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:50:28.843806 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:50:28.843806 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:50:28.843806 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:50:28.843806 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:50:28.843806 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 09:50:28.843806 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 09:50:28.843806 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 09:50:28.843806 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 09:50:28.843806 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 09:50:28.843806 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:50:28.843806 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 16 09:50:28.843806 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 09:50:28.844775 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 83562849-a9fe-40c8-882d-7f952b49f025 could not be found. Sep 16 09:50:28.844775 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:50:28.844775 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:50:28.844775 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:50:28.844775 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:50:28.844775 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:50:28.844775 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:50:28.844775 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 09:50:28.844775 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 09:50:28.844775 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 83562849-a9fe-40c8-882d-7f952b49f025 could not be found. Sep 16 09:50:28.844775 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:50:28.844775 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-68d8022a-3357-4ed5-98d6-e7ba106b4f33 tempest-VolumesNegativeTest-508182641 tempest-VolumesNegativeTest-508182641-project] Returning 404 to user: Volume 83562849-a9fe-40c8-882d-7f952b49f025 could not be found. {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 09:50:28.844775 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-68d8022a-3357-4ed5-98d6-e7ba106b4f33 tempest-VolumesNegativeTest-508182641 tempest-VolumesNegativeTest-508182641-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/83562849-a9fe-40c8-882d-7f952b49f025" status: 404 len: 109 microversion: 2.1 time: 0.041918 Sep 16 09:50:28.844775 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 8/8] 10.222.0.73 () {58 vars in 1245 bytes} [Fri Sep 16 09:50:28 2022] GET /compute/v2.1/os-volumes/83562849-a9fe-40c8-882d-7f952b49f025 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 09:50:29.624171 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-431379c6-42fa-46a6-ad20-62a35104d246 tempest-VolumesGetTestJSON-805888 tempest-VolumesGetTestJSON-805888-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.387193 Sep 16 09:50:29.624935 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 1/9] 10.222.0.73 () {60 vars in 1156 bytes} [Fri Sep 16 09:50:26 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3390 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 16 09:50:29.641207 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-44b522b0-e1c4-444d-bab8-6c20106fd40a tempest-VolumesGetTestJSON-805888 tempest-VolumesGetTestJSON-805888-project] Calling method '.version_select at 0x7ffa6ea60e50>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:50:29.778991 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-44b522b0-e1c4-444d-bab8-6c20106fd40a tempest-VolumesGetTestJSON-805888 tempest-VolumesGetTestJSON-805888-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/ef0ae11b-a9c7-452a-b47d-b2094f8cdb28" status: 200 len: 353 microversion: 2.1 time: 0.141995 Sep 16 09:50:29.789229 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 9/10] 10.222.0.73 () {58 vars in 1245 bytes} [Fri Sep 16 09:50:29 2022] GET /compute/v2.1/os-volumes/ef0ae11b-a9c7-452a-b47d-b2094f8cdb28 => generated 353 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:50:30.796743 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-a870e34c-6c51-49bc-95a8-42c638e40945 tempest-VolumesGetTestJSON-805888 tempest-VolumesGetTestJSON-805888-project] Calling method '.version_select at 0x7ffa6ea7a310>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:50:31.072385 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-a870e34c-6c51-49bc-95a8-42c638e40945 tempest-VolumesGetTestJSON-805888 tempest-VolumesGetTestJSON-805888-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/ef0ae11b-a9c7-452a-b47d-b2094f8cdb28" status: 200 len: 354 microversion: 2.1 time: 0.281841 Sep 16 09:50:31.073250 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 2/11] 10.222.0.73 () {58 vars in 1245 bytes} [Fri Sep 16 09:50:30 2022] GET /compute/v2.1/os-volumes/ef0ae11b-a9c7-452a-b47d-b2094f8cdb28 => generated 354 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:50:31.094580 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-8327a28b-b619-4fe6-ac41-efe4d32c7530 tempest-VolumesGetTestJSON-805888 tempest-VolumesGetTestJSON-805888-project] Calling method '.version_select at 0x7ffa6e994940>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:50:31.265595 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-8327a28b-b619-4fe6-ac41-efe4d32c7530 tempest-VolumesGetTestJSON-805888 tempest-VolumesGetTestJSON-805888-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/ef0ae11b-a9c7-452a-b47d-b2094f8cdb28" status: 200 len: 354 microversion: 2.1 time: 0.174648 Sep 16 09:50:31.273698 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 10/12] 10.222.0.73 () {58 vars in 1245 bytes} [Fri Sep 16 09:50:31 2022] GET /compute/v2.1/os-volumes/ef0ae11b-a9c7-452a-b47d-b2094f8cdb28 => generated 354 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:50:31.289639 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-f37f428c-8a28-4ef3-8528-7c5f6cf7579d tempest-VolumesGetTestJSON-805888 tempest-VolumesGetTestJSON-805888-project] Calling method '.version_select at 0x7ffa6ea7a9d0>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:50:31.612787 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-f37f428c-8a28-4ef3-8528-7c5f6cf7579d tempest-VolumesGetTestJSON-805888 tempest-VolumesGetTestJSON-805888-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/ef0ae11b-a9c7-452a-b47d-b2094f8cdb28" status: 202 len: 0 microversion: 2.1 time: 0.327553 Sep 16 09:50:31.614063 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 3/13] 10.222.0.73 () {58 vars in 1248 bytes} [Fri Sep 16 09:50:31 2022] DELETE /compute/v2.1/os-volumes/ef0ae11b-a9c7-452a-b47d-b2094f8cdb28 => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 09:50:31.637630 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-52d594f3-aeb9-4157-8178-8ee24beb675a tempest-VolumesGetTestJSON-805888 tempest-VolumesGetTestJSON-805888-project] Calling method '.version_select at 0x7ffa6e9941f0>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:50:31.697015 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-52d594f3-aeb9-4157-8178-8ee24beb675a tempest-VolumesGetTestJSON-805888 tempest-VolumesGetTestJSON-805888-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/ef0ae11b-a9c7-452a-b47d-b2094f8cdb28" status: 200 len: 353 microversion: 2.1 time: 0.076597 Sep 16 09:50:31.703746 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 11/14] 10.222.0.73 () {58 vars in 1245 bytes} [Fri Sep 16 09:50:31 2022] GET /compute/v2.1/os-volumes/ef0ae11b-a9c7-452a-b47d-b2094f8cdb28 => generated 353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:50:32.712280 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-cc2b1c73-a4c8-4483-a666-f941b87bb79e tempest-VolumesGetTestJSON-805888 tempest-VolumesGetTestJSON-805888-project] Calling method '.version_select at 0x7ffa6ea100d0>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:50:32.934285 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.wsgi [None req-cc2b1c73-a4c8-4483-a666-f941b87bb79e tempest-VolumesGetTestJSON-805888 tempest-VolumesGetTestJSON-805888-project] HTTP exception thrown: Volume ef0ae11b-a9c7-452a-b47d-b2094f8cdb28 could not be found. Sep 16 09:50:32.939849 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-cc2b1c73-a4c8-4483-a666-f941b87bb79e tempest-VolumesGetTestJSON-805888 tempest-VolumesGetTestJSON-805888-project] Request method failure captured: Sep 16 09:50:32.939849 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: request: GET /compute/v2.1/os-volumes/ef0ae11b-a9c7-452a-b47d-b2094f8cdb28 HTTP/1.1 Sep 16 09:50:32.939849 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept: application/json Sep 16 09:50:32.939849 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept-Encoding: identity Sep 16 09:50:32.939849 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Connection: close Sep 16 09:50:32.939849 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Length: 0 Sep 16 09:50:32.939849 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Type: application/json Sep 16 09:50:32.939849 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Host: 10.222.0.73 Sep 16 09:50:32.939849 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Openstack-System-Scope: None Sep 16 09:50:32.939849 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: User-Agent: python-urllib3/1.26.12 Sep 16 09:50:32.939849 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Auth-Token: gAAAAABjJEbiI1NcWxP6hXJ0YeTp8nELXqNSA6xyeXX0O5bwFyoAI_zzQ0_JTEsQLnD5eNFG9tNGxbkCFKaEeTg39-Ys2-kejl-6qSHDd8tLKthg1EaIizcx66Vcvks1PjE4g0pDWVlw3bAWgEXj34iaD4kwVTgcDOJaqKmHkT_BUD1btIBIyiM Sep 16 09:50:32.939849 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Id: None Sep 16 09:50:32.939849 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Name: None Sep 16 09:50:32.939849 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Identity-Status: Confirmed Sep 16 09:50:32.939849 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Is-Admin-Project: True Sep 16 09:50:32.939849 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Id: default Sep 16 09:50:32.939849 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Name: Default Sep 16 09:50:32.939849 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Id: e763d1f3dcb2488597b03156ef064d37 Sep 16 09:50:32.939849 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Name: tempest-VolumesGetTestJSON-805888 Sep 16 09:50:32.939849 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Role: reader,member Sep 16 09:50:32.939849 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Roles: reader,member Sep 16 09:50:32.941113 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/e763d1f3dcb2488597b03156ef064d37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_e763d1f3dcb2488597b03156ef064d37", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/e763d1f3dcb2488597b03156ef064d37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/e763d1f3dcb2488597b03156ef064d37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 09:50:32.941113 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant: tempest-VolumesGetTestJSON-805888 Sep 16 09:50:32.941113 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Id: e763d1f3dcb2488597b03156ef064d37 Sep 16 09:50:32.941113 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Name: tempest-VolumesGetTestJSON-805888 Sep 16 09:50:32.941113 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User: tempest-VolumesGetTestJSON-805888-project Sep 16 09:50:32.941113 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Id: default Sep 16 09:50:32.941113 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Name: Default Sep 16 09:50:32.941113 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Id: 5adc119fd1d24558aace4f38fd2db081 Sep 16 09:50:32.941113 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Name: tempest-VolumesGetTestJSON-805888-project Sep 16 09:50:32.941113 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: method: Sep 16 09:50:32.941113 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: exception: Volume ef0ae11b-a9c7-452a-b47d-b2094f8cdb28 could not be found. Sep 16 09:50:32.941113 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: action_args: {'id': 'ef0ae11b-a9c7-452a-b47d-b2094f8cdb28'} Sep 16 09:50:32.941113 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 09:50:32.941989 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:50:32.941989 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 09:50:32.941989 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 09:50:32.941989 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 16 09:50:32.941989 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 16 09:50:32.941989 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 16 09:50:32.941989 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 16 09:50:32.941989 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 09:50:32.941989 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 09:50:32.941989 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 09:50:32.941989 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 09:50:32.941989 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 09:50:32.941989 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 09:50:32.941989 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 09:50:32.941989 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 09:50:32.941989 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ef0ae11b-a9c7-452a-b47d-b2094f8cdb28 could not be found. (HTTP 404) (Request-ID: req-b71c9631-ac67-46ab-8b36-3df0ac3d6e93) Sep 16 09:50:32.941989 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:50:32.941989 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:50:32.941989 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:50:32.942970 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:50:32.942970 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 16 09:50:32.942970 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 16 09:50:32.942970 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 16 09:50:32.942970 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 16 09:50:32.942970 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 16 09:50:32.942970 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 16 09:50:32.942970 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 16 09:50:32.942970 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 16 09:50:32.942970 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 09:50:32.942970 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 09:50:32.942970 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 16 09:50:32.942970 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 16 09:50:32.942970 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 16 09:50:32.942970 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 16 09:50:32.942970 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 09:50:32.942970 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 09:50:32.942970 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 09:50:32.942970 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 09:50:32.944495 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 09:50:32.944495 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 09:50:32.944495 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 09:50:32.944495 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 09:50:32.944495 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ef0ae11b-a9c7-452a-b47d-b2094f8cdb28 could not be found. Sep 16 09:50:32.944495 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:50:32.944495 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:50:32.944495 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:50:32.944495 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:50:32.944495 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:50:32.944495 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:50:32.944495 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 09:50:32.944495 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 09:50:32.944495 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 09:50:32.944495 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 09:50:32.944495 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 09:50:32.944495 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:50:32.944495 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 16 09:50:32.944495 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 09:50:32.945437 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ef0ae11b-a9c7-452a-b47d-b2094f8cdb28 could not be found. Sep 16 09:50:32.945437 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:50:32.945437 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:50:32.945437 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:50:32.945437 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:50:32.945437 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:50:32.945437 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:50:32.945437 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 09:50:32.945437 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 09:50:32.945437 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ef0ae11b-a9c7-452a-b47d-b2094f8cdb28 could not be found. Sep 16 09:50:32.945437 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:50:32.945437 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-cc2b1c73-a4c8-4483-a666-f941b87bb79e tempest-VolumesGetTestJSON-805888 tempest-VolumesGetTestJSON-805888-project] Returning 404 to user: Volume ef0ae11b-a9c7-452a-b47d-b2094f8cdb28 could not be found. {{(pid=127671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 09:50:32.945437 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-cc2b1c73-a4c8-4483-a666-f941b87bb79e tempest-VolumesGetTestJSON-805888 tempest-VolumesGetTestJSON-805888-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/ef0ae11b-a9c7-452a-b47d-b2094f8cdb28" status: 404 len: 109 microversion: 2.1 time: 0.234416 Sep 16 09:50:32.947680 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 4/15] 10.222.0.73 () {58 vars in 1245 bytes} [Fri Sep 16 09:50:32 2022] GET /compute/v2.1/os-volumes/ef0ae11b-a9c7-452a-b47d-b2094f8cdb28 => generated 109 bytes in 241 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 09:50:39.431883 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-1300490d-6046-4cbe-8d9f-f1aea861f313 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Action: 'create', calling method: .version_select at 0x7ffa6e994ee0>, body: {"keypair": {"name": "tempest-keypair-424244921", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5a+mS+mBgknK5Qr741wiBZwsG6o0gyHPgbsaiOh5YRhDoNdNVo6NDU9RdUyByhnzYr7YOofxZlZV0z7GlcQ4A6sNfKI/uLjJKSFJqE1KSBprxHRFthVErnFyNH7dycrw=="}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:50:39.587901 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-1300490d-6046-4cbe-8d9f-f1aea861f313 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Getting quotas for project f1713f13f3ff494496a8ef8e5591c1b6. Resources: {'key_pairs'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 09:50:39.606946 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-1300490d-6046-4cbe-8d9f-f1aea861f313 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Getting quotas for user bc95a607e1ef43d592a5289f80464424 and project f1713f13f3ff494496a8ef8e5591c1b6. Resources: {'key_pairs'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 09:50:39.874528 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-1300490d-6046-4cbe-8d9f-f1aea861f313 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.115827 Sep 16 09:50:39.875536 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 12/16] 10.222.0.73 () {62 vars in 1200 bytes} [Fri Sep 16 09:50:38 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1117 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 16 09:50:42.415385 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-9851e0f6-e81a-46c8-8d6d-04814ea3376a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1469136706", "imageRef": "30d28050-ec9d-4227-9bb0-5247430f6177", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:50:42.553391 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-273f95e7-436e-4c26-b79a-63bd87d4d2bc tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Action: 'create', calling method: .version_select at 0x7ffa6e95f670>, body: {"keypair": {"name": "tempest-keypair-1826692380", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJhyB2FV/U1idqIsj5gRqn4MTY1wVfO+n2dn3s2qU53AK4dhhUS3WDeKcugFTX7ZTVfYA8q4sw/DlOMW0DJEYJ8u+9M9YkpzJAPDbZV1x/+N1/0FTi04Rn4xsPTxep5iiQ=="}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:50:42.623137 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-273f95e7-436e-4c26-b79a-63bd87d4d2bc tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Getting quotas for project 75007587f92646f686881c2e1bfb7b2d. Resources: {'key_pairs'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 09:50:42.646554 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-273f95e7-436e-4c26-b79a-63bd87d4d2bc tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Getting quotas for user 7dca5726e89343828e25def6e6c274bb and project 75007587f92646f686881c2e1bfb7b2d. Resources: {'key_pairs'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 09:50:42.691267 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.network.neutron [None req-9851e0f6-e81a-46c8-8d6d-04814ea3376a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] validate_networks() for [('17684eae-ad40-4ec5-9092-8a60e4e87e96', None, None, None, None, None)] {{(pid=127671) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 09:50:42.872498 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-273f95e7-436e-4c26-b79a-63bd87d4d2bc tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.498080 Sep 16 09:50:42.873851 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 13/17] 10.222.0.73 () {60 vars in 1159 bytes} [Fri Sep 16 09:50:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:50:44.201927 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-c756bb90-e8dd-40f6-9896-f5ea7d08f250 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1940928448", "imageRef": "30d28050-ec9d-4227-9bb0-5247430f6177", "flavorRef": "452", "networks": [{"uuid": "c4842324-ee85-46c7-9e8f-0b04468e9bb4"}]}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:50:44.336726 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.network.neutron [None req-c756bb90-e8dd-40f6-9896-f5ea7d08f250 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] validate_networks() for [('c4842324-ee85-46c7-9e8f-0b04468e9bb4', None, None, None, None, None)] {{(pid=127670) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 09:50:45.618684 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.virt.hardware [None req-9851e0f6-e81a-46c8-8d6d-04814ea3376a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Flavor limits 0:0:0 {{(pid=127671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 09:50:45.619227 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.virt.hardware [None req-9851e0f6-e81a-46c8-8d6d-04814ea3376a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Image limits 0:0:0 {{(pid=127671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 09:50:45.619576 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.virt.hardware [None req-9851e0f6-e81a-46c8-8d6d-04814ea3376a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Flavor pref 0:0:0 {{(pid=127671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 09:50:45.619980 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.virt.hardware [None req-9851e0f6-e81a-46c8-8d6d-04814ea3376a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Image pref 0:0:0 {{(pid=127671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 09:50:45.620426 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.virt.hardware [None req-9851e0f6-e81a-46c8-8d6d-04814ea3376a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 09:50:45.673770 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9851e0f6-e81a-46c8-8d6d-04814ea3376a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:50:45.688439 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9851e0f6-e81a-46c8-8d6d-04814ea3376a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:50:45.688439 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9851e0f6-e81a-46c8-8d6d-04814ea3376a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:50:45.688439 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9851e0f6-e81a-46c8-8d6d-04814ea3376a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:50:45.688439 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9851e0f6-e81a-46c8-8d6d-04814ea3376a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:50:45.689103 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9851e0f6-e81a-46c8-8d6d-04814ea3376a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:50:45.774813 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.quota [None req-9851e0f6-e81a-46c8-8d6d-04814ea3376a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Getting quotas for project 3fe0d52d42324aa38182b47b3588b979. Resources: {'instances', 'cores', 'ram'} {{(pid=127671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 09:50:45.784317 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.quota [None req-9851e0f6-e81a-46c8-8d6d-04814ea3376a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Getting quotas for user 8d1ce0bdadbc48d2899c7cdded5acb5c and project 3fe0d52d42324aa38182b47b3588b979. Resources: {'instances', 'cores', 'ram'} {{(pid=127671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 09:50:45.799142 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-9851e0f6-e81a-46c8-8d6d-04814ea3376a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Going to run 1 instances... {{(pid=127671) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 09:50:45.802469 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-9851e0f6-e81a-46c8-8d6d-04814ea3376a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: f634aa6d-e24c-48df-946f-3166fd76273a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='30d28050-ec9d-4227-9bb0-5247430f6177',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 09:50:46.046896 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-9851e0f6-e81a-46c8-8d6d-04814ea3376a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.061602 Sep 16 09:50:46.063475 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 5/18] 10.222.0.73 () {60 vars in 1147 bytes} [Fri Sep 16 09:50:41 2022] POST /compute/v2.1/servers => generated 383 bytes in 4079 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 09:50:46.088815 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-61bbfa7b-9bc4-40c6-bb2a-27c07a27c916 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:50:46.091730 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-61bbfa7b-9bc4-40c6-bb2a-27c07a27c916 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: f634aa6d-e24c-48df-946f-3166fd76273a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:50:46.327870 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-61bbfa7b-9bc4-40c6-bb2a-27c07a27c916 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:50:46.371132 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-61bbfa7b-9bc4-40c6-bb2a-27c07a27c916 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a" status: 200 len: 1222 microversion: 2.1 time: 0.306219 Sep 16 09:50:46.374867 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 6/19] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:50:46 2022] GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a => generated 1222 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:50:46.494002 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-6a770605-8cd7-40ae-bff5-6490edefade2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1061770553", "imageRef": "30d28050-ec9d-4227-9bb0-5247430f6177", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:50:46.630746 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.network.neutron [None req-6a770605-8cd7-40ae-bff5-6490edefade2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] validate_networks() for [('17684eae-ad40-4ec5-9092-8a60e4e87e96', None, None, None, None, None)] {{(pid=127671) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 09:50:46.804110 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-c756bb90-e8dd-40f6-9896-f5ea7d08f250 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Flavor limits 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 09:50:46.804110 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-c756bb90-e8dd-40f6-9896-f5ea7d08f250 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Image limits 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 09:50:46.804110 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-c756bb90-e8dd-40f6-9896-f5ea7d08f250 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Flavor pref 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 09:50:46.804968 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-c756bb90-e8dd-40f6-9896-f5ea7d08f250 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Image pref 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 09:50:46.805676 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-c756bb90-e8dd-40f6-9896-f5ea7d08f250 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 09:50:46.839819 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c756bb90-e8dd-40f6-9896-f5ea7d08f250 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:50:46.844170 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c756bb90-e8dd-40f6-9896-f5ea7d08f250 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:50:46.844998 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c756bb90-e8dd-40f6-9896-f5ea7d08f250 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:50:46.845974 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c756bb90-e8dd-40f6-9896-f5ea7d08f250 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:50:46.848058 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c756bb90-e8dd-40f6-9896-f5ea7d08f250 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:50:46.848753 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c756bb90-e8dd-40f6-9896-f5ea7d08f250 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:50:46.918881 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-c756bb90-e8dd-40f6-9896-f5ea7d08f250 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Getting quotas for project cca830d4d9384e99b6f499a457776de4. Resources: {'instances', 'cores', 'ram'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 09:50:46.923634 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-c756bb90-e8dd-40f6-9896-f5ea7d08f250 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Getting quotas for user 807093ae546a4e42a21c2755f49abc59 and project cca830d4d9384e99b6f499a457776de4. Resources: {'instances', 'cores', 'ram'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 09:50:47.016732 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-c756bb90-e8dd-40f6-9896-f5ea7d08f250 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Going to run 1 instances... {{(pid=127670) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 09:50:47.024746 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-c756bb90-e8dd-40f6-9896-f5ea7d08f250 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] [instance: 480def5d-9bba-44e0-a53c-65239a428e1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='30d28050-ec9d-4227-9bb0-5247430f6177',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 09:50:47.225494 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-c756bb90-e8dd-40f6-9896-f5ea7d08f250 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.155811 Sep 16 09:50:47.230097 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 14/20] 10.222.0.73 () {60 vars in 1147 bytes} [Fri Sep 16 09:50:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 3161 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 09:50:47.244105 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-8cab9eae-2ddd-4ad4-ba8c-2fb8927d633b tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:50:47.245168 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-8cab9eae-2ddd-4ad4-ba8c-2fb8927d633b tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] [instance: 480def5d-9bba-44e0-a53c-65239a428e1c] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:50:47.539941 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-8cab9eae-2ddd-4ad4-ba8c-2fb8927d633b tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807093ae546a4e42a21c2755f49abc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cca830d4d9384e99b6f499a457776de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:50:47.584913 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-8cab9eae-2ddd-4ad4-ba8c-2fb8927d633b tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] 10.222.0.73 "GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c" status: 200 len: 1215 microversion: 2.1 time: 0.345993 Sep 16 09:50:47.587473 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 15/21] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:50:47 2022] GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c => generated 1215 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:50:48.614209 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-c9b268f1-40a6-4207-81e3-466154885e17 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:50:48.615311 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-c9b268f1-40a6-4207-81e3-466154885e17 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] [instance: 480def5d-9bba-44e0-a53c-65239a428e1c] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:50:48.980837 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c9b268f1-40a6-4207-81e3-466154885e17 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807093ae546a4e42a21c2755f49abc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cca830d4d9384e99b6f499a457776de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:50:48.989383 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-c9b268f1-40a6-4207-81e3-466154885e17 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] 10.222.0.73 "GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c" status: 200 len: 1215 microversion: 2.1 time: 0.379176 Sep 16 09:50:49.001989 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 16/22] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:50:48 2022] GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c => generated 1215 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:50:49.202894 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.virt.hardware [None req-6a770605-8cd7-40ae-bff5-6490edefade2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Flavor limits 0:0:0 {{(pid=127671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 09:50:49.206061 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.virt.hardware [None req-6a770605-8cd7-40ae-bff5-6490edefade2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Image limits 0:0:0 {{(pid=127671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 09:50:49.206580 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.virt.hardware [None req-6a770605-8cd7-40ae-bff5-6490edefade2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Flavor pref 0:0:0 {{(pid=127671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 09:50:49.206983 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.virt.hardware [None req-6a770605-8cd7-40ae-bff5-6490edefade2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Image pref 0:0:0 {{(pid=127671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 09:50:49.207612 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.virt.hardware [None req-6a770605-8cd7-40ae-bff5-6490edefade2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 09:50:49.243712 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6a770605-8cd7-40ae-bff5-6490edefade2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:50:49.244269 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6a770605-8cd7-40ae-bff5-6490edefade2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:50:49.244719 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6a770605-8cd7-40ae-bff5-6490edefade2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:50:49.245517 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6a770605-8cd7-40ae-bff5-6490edefade2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:50:49.247168 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6a770605-8cd7-40ae-bff5-6490edefade2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:50:49.247168 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6a770605-8cd7-40ae-bff5-6490edefade2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:50:49.312454 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.quota [None req-6a770605-8cd7-40ae-bff5-6490edefade2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Getting quotas for project 3fe0d52d42324aa38182b47b3588b979. Resources: {'instances', 'cores', 'ram'} {{(pid=127671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 09:50:49.338661 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.quota [None req-6a770605-8cd7-40ae-bff5-6490edefade2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Getting quotas for user 8d1ce0bdadbc48d2899c7cdded5acb5c and project 3fe0d52d42324aa38182b47b3588b979. Resources: {'instances', 'cores', 'ram'} {{(pid=127671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 09:50:49.384145 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-6a770605-8cd7-40ae-bff5-6490edefade2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Going to run 1 instances... {{(pid=127671) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 09:50:49.391219 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-6a770605-8cd7-40ae-bff5-6490edefade2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='30d28050-ec9d-4227-9bb0-5247430f6177',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 09:50:49.720127 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-3bdae610-94fb-4247-b02b-c779dd0ceb05 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-478619559", "imageRef": "30d28050-ec9d-4227-9bb0-5247430f6177", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fe465541-6175-450e-8791-dc7a519b5e60"}], "security_groups": [{"name": "tempest-securitygroup--3469658"}], "key_name": "tempest-keypair-424244921", "user_data": "}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:50:49.740397 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-6a770605-8cd7-40ae-bff5-6490edefade2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.259617 Sep 16 09:50:49.750937 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 7/23] 10.222.0.73 () {60 vars in 1147 bytes} [Fri Sep 16 09:50:46 2022] POST /compute/v2.1/servers => generated 383 bytes in 3271 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 09:50:49.767730 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-d82a6ace-7b3d-4ca0-bf3c-f3ffecde3266 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:50:49.768697 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-d82a6ace-7b3d-4ca0-bf3c-f3ffecde3266 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:50:50.218725 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-d82a6ace-7b3d-4ca0-bf3c-f3ffecde3266 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:50:50.230684 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-d82a6ace-7b3d-4ca0-bf3c-f3ffecde3266 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1222 microversion: 2.1 time: 0.476182 Sep 16 09:50:50.231312 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 8/24] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:50:49 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1222 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:50:50.256167 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-91a10043-a806-4bb3-986b-1cb5321425a7 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:50:50.257132 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-91a10043-a806-4bb3-986b-1cb5321425a7 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] [instance: 480def5d-9bba-44e0-a53c-65239a428e1c] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:50:50.266452 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-91a10043-a806-4bb3-986b-1cb5321425a7 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:50:50.267428 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-91a10043-a806-4bb3-986b-1cb5321425a7 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:50:50.268145 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-91a10043-a806-4bb3-986b-1cb5321425a7 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:50:50.269158 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-91a10043-a806-4bb3-986b-1cb5321425a7 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:50:50.274777 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-91a10043-a806-4bb3-986b-1cb5321425a7 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:50:50.275482 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-91a10043-a806-4bb3-986b-1cb5321425a7 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:50:50.303723 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.network.neutron [None req-3bdae610-94fb-4247-b02b-c779dd0ceb05 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] validate_networks() for [('fe465541-6175-450e-8791-dc7a519b5e60', None, None, None, None, None)] {{(pid=127670) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 09:50:50.950893 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-91a10043-a806-4bb3-986b-1cb5321425a7 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807093ae546a4e42a21c2755f49abc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cca830d4d9384e99b6f499a457776de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:50:50.999639 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-91a10043-a806-4bb3-986b-1cb5321425a7 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] 10.222.0.73 "GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c" status: 200 len: 1219 microversion: 2.1 time: 0.749410 Sep 16 09:50:51.001403 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 9/25] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:50:50 2022] GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c => generated 1219 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:50:51.229972 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-3bdae610-94fb-4247-b02b-c779dd0ceb05 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Flavor limits 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 09:50:51.230596 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-3bdae610-94fb-4247-b02b-c779dd0ceb05 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Image limits 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 09:50:51.231273 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-3bdae610-94fb-4247-b02b-c779dd0ceb05 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Flavor pref 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 09:50:51.231882 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-3bdae610-94fb-4247-b02b-c779dd0ceb05 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Image pref 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 09:50:51.232500 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-3bdae610-94fb-4247-b02b-c779dd0ceb05 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 09:50:51.242630 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3bdae610-94fb-4247-b02b-c779dd0ceb05 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:50:51.243617 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3bdae610-94fb-4247-b02b-c779dd0ceb05 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:50:51.244261 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3bdae610-94fb-4247-b02b-c779dd0ceb05 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:50:51.245066 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3bdae610-94fb-4247-b02b-c779dd0ceb05 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:50:51.245528 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3bdae610-94fb-4247-b02b-c779dd0ceb05 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:50:51.246020 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3bdae610-94fb-4247-b02b-c779dd0ceb05 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:50:51.259497 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-f444c2de-e022-4757-9089-1c789f499bda tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:50:51.260375 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-f444c2de-e022-4757-9089-1c789f499bda tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:50:51.275505 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-3bdae610-94fb-4247-b02b-c779dd0ceb05 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Getting quotas for project f1713f13f3ff494496a8ef8e5591c1b6. Resources: {'instances', 'cores', 'ram'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 09:50:51.280452 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-3bdae610-94fb-4247-b02b-c779dd0ceb05 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Getting quotas for user bc95a607e1ef43d592a5289f80464424 and project f1713f13f3ff494496a8ef8e5591c1b6. Resources: {'instances', 'cores', 'ram'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 09:50:51.299755 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-3bdae610-94fb-4247-b02b-c779dd0ceb05 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Going to run 1 instances... {{(pid=127670) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 09:50:51.302922 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-3bdae610-94fb-4247-b02b-c779dd0ceb05 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='30d28050-ec9d-4227-9bb0-5247430f6177',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 09:50:51.366049 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-f444c2de-e022-4757-9089-1c789f499bda tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:50:51.388624 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-f444c2de-e022-4757-9089-1c789f499bda tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1222 microversion: 2.1 time: 0.134572 Sep 16 09:50:51.391040 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 10/26] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:50:51 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1222 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:50:51.577004 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-3bdae610-94fb-4247-b02b-c779dd0ceb05 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 1.861731 Sep 16 09:50:51.584243 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 17/27] 10.222.0.73 () {62 vars in 1188 bytes} [Fri Sep 16 09:50:49 2022] POST /compute/v2.1/servers => generated 399 bytes in 1869 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 16 09:50:51.601285 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-2bd113ec-0d3e-4425-8944-6d2cb8cc4ae9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:50:51.601285 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-2bd113ec-0d3e-4425-8944-6d2cb8cc4ae9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:50:51.687434 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-2bd113ec-0d3e-4425-8944-6d2cb8cc4ae9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:50:51.704392 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-2bd113ec-0d3e-4425-8944-6d2cb8cc4ae9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:50:51.706963 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-2bd113ec-0d3e-4425-8944-6d2cb8cc4ae9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:50:51.707595 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-9d748587-79b0-4dfd-a1ca-649ecf82b3e6 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-135064929", "imageRef": "30d28050-ec9d-4227-9bb0-5247430f6177", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b92b7908-54f3-4444-8e37-e6621fa07310"}], "security_groups": [{"name": "tempest-securitygroup--661305458"}], "key_name": "tempest-keypair-1826692380", "user_data": "}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:50:51.709296 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-2bd113ec-0d3e-4425-8944-6d2cb8cc4ae9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1280 microversion: 2.20 time: 0.120103 Sep 16 09:50:51.710119 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 11/28] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:50:51 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1280 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:50:52.011840 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.network.neutron [None req-9d748587-79b0-4dfd-a1ca-649ecf82b3e6 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] validate_networks() for [('b92b7908-54f3-4444-8e37-e6621fa07310', None, None, None, None, None)] {{(pid=127670) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 09:50:52.025453 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-1ab04c1f-0aec-4832-91ae-11a0be75c81a tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:50:52.026253 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-1ab04c1f-0aec-4832-91ae-11a0be75c81a tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] [instance: 480def5d-9bba-44e0-a53c-65239a428e1c] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:50:52.039576 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1ab04c1f-0aec-4832-91ae-11a0be75c81a tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:50:52.042268 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1ab04c1f-0aec-4832-91ae-11a0be75c81a tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:50:52.051732 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1ab04c1f-0aec-4832-91ae-11a0be75c81a tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:50:52.051732 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1ab04c1f-0aec-4832-91ae-11a0be75c81a tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:50:52.051732 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1ab04c1f-0aec-4832-91ae-11a0be75c81a tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:50:52.051732 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1ab04c1f-0aec-4832-91ae-11a0be75c81a tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:50:52.194512 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-1ab04c1f-0aec-4832-91ae-11a0be75c81a tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807093ae546a4e42a21c2755f49abc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cca830d4d9384e99b6f499a457776de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:50:52.204386 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-1ab04c1f-0aec-4832-91ae-11a0be75c81a tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] 10.222.0.73 "GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c" status: 200 len: 1267 microversion: 2.1 time: 0.184056 Sep 16 09:50:52.205861 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 12/29] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:50:52 2022] GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c => generated 1267 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:50:52.416812 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-8e610e87-7f4c-448e-a88e-7c6e70e3179f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:50:52.417850 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-8e610e87-7f4c-448e-a88e-7c6e70e3179f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:50:52.433114 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8e610e87-7f4c-448e-a88e-7c6e70e3179f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:50:52.435421 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8e610e87-7f4c-448e-a88e-7c6e70e3179f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:50:52.438343 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8e610e87-7f4c-448e-a88e-7c6e70e3179f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:50:52.439432 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8e610e87-7f4c-448e-a88e-7c6e70e3179f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:50:52.440184 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8e610e87-7f4c-448e-a88e-7c6e70e3179f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:50:52.440971 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8e610e87-7f4c-448e-a88e-7c6e70e3179f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:50:52.766919 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-8e610e87-7f4c-448e-a88e-7c6e70e3179f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:50:52.788651 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-8e610e87-7f4c-448e-a88e-7c6e70e3179f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1218 microversion: 2.1 time: 0.378062 Sep 16 09:50:52.795605 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 13/30] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:50:52 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1218 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:50:52.800613 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-bfc79785-e21c-4c73-8faf-62e3ee9a4e3c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:50:52.801246 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-bfc79785-e21c-4c73-8faf-62e3ee9a4e3c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:50:53.082785 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-9d748587-79b0-4dfd-a1ca-649ecf82b3e6 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Flavor limits 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 09:50:53.084843 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-9d748587-79b0-4dfd-a1ca-649ecf82b3e6 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Image limits 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 09:50:53.085340 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-9d748587-79b0-4dfd-a1ca-649ecf82b3e6 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Flavor pref 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 09:50:53.086074 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-9d748587-79b0-4dfd-a1ca-649ecf82b3e6 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Image pref 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 09:50:53.086697 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-9d748587-79b0-4dfd-a1ca-649ecf82b3e6 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 09:50:53.106432 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9d748587-79b0-4dfd-a1ca-649ecf82b3e6 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:50:53.107803 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9d748587-79b0-4dfd-a1ca-649ecf82b3e6 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:50:53.108072 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9d748587-79b0-4dfd-a1ca-649ecf82b3e6 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:50:53.111019 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9d748587-79b0-4dfd-a1ca-649ecf82b3e6 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:50:53.111019 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9d748587-79b0-4dfd-a1ca-649ecf82b3e6 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:50:53.111019 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9d748587-79b0-4dfd-a1ca-649ecf82b3e6 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:50:53.161610 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-bfc79785-e21c-4c73-8faf-62e3ee9a4e3c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:50:53.185051 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-9d748587-79b0-4dfd-a1ca-649ecf82b3e6 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Getting quotas for project 75007587f92646f686881c2e1bfb7b2d. Resources: {'instances', 'cores', 'ram'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 09:50:53.203197 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-9d748587-79b0-4dfd-a1ca-649ecf82b3e6 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Getting quotas for user 7dca5726e89343828e25def6e6c274bb and project 75007587f92646f686881c2e1bfb7b2d. Resources: {'instances', 'cores', 'ram'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 09:50:53.205743 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-bfc79785-e21c-4c73-8faf-62e3ee9a4e3c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:50:53.227848 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-bfc79785-e21c-4c73-8faf-62e3ee9a4e3c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:50:53.236035 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-bfc79785-e21c-4c73-8faf-62e3ee9a4e3c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1280 microversion: 2.20 time: 0.437871 Sep 16 09:50:53.242274 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 14/31] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:50:52 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1280 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:50:53.254286 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-9d748587-79b0-4dfd-a1ca-649ecf82b3e6 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Going to run 1 instances... {{(pid=127670) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 09:50:53.269591 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-9d748587-79b0-4dfd-a1ca-649ecf82b3e6 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: efec4ecb-65e7-4ca8-a29f-b87bc9ee1915] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='30d28050-ec9d-4227-9bb0-5247430f6177',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 09:50:53.270276 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-2b445cfc-137b-4c53-85d6-0db479ba0f4a tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:50:53.276106 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-2b445cfc-137b-4c53-85d6-0db479ba0f4a tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] [instance: 480def5d-9bba-44e0-a53c-65239a428e1c] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:50:53.311325 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2b445cfc-137b-4c53-85d6-0db479ba0f4a tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:50:53.314618 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2b445cfc-137b-4c53-85d6-0db479ba0f4a tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:50:53.322477 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2b445cfc-137b-4c53-85d6-0db479ba0f4a tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:50:53.324686 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2b445cfc-137b-4c53-85d6-0db479ba0f4a tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:50:53.328649 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2b445cfc-137b-4c53-85d6-0db479ba0f4a tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:50:53.331463 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2b445cfc-137b-4c53-85d6-0db479ba0f4a tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:50:53.544500 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-9d748587-79b0-4dfd-a1ca-649ecf82b3e6 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.842724 Sep 16 09:50:53.551819 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 18/32] 10.222.0.73 () {60 vars in 1147 bytes} [Fri Sep 16 09:50:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 1851 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 16 09:50:53.564457 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-e676d952-76f8-4dd3-bc12-602a7a2901a9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:50:53.566179 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-e676d952-76f8-4dd3-bc12-602a7a2901a9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: efec4ecb-65e7-4ca8-a29f-b87bc9ee1915] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:50:53.635248 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-2b445cfc-137b-4c53-85d6-0db479ba0f4a tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807093ae546a4e42a21c2755f49abc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cca830d4d9384e99b6f499a457776de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:50:53.654682 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-2b445cfc-137b-4c53-85d6-0db479ba0f4a tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] 10.222.0.73 "GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c" status: 200 len: 1285 microversion: 2.1 time: 0.406524 Sep 16 09:50:53.655359 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 15/33] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:50:53 2022] GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c => generated 1285 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:50:53.796742 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-e676d952-76f8-4dd3-bc12-602a7a2901a9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:50:53.818410 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-e676d952-76f8-4dd3-bc12-602a7a2901a9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915" status: 200 len: 1241 microversion: 2.1 time: 0.253844 Sep 16 09:50:53.818410 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 19/34] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:50:53 2022] GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 => generated 1241 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:50:53.835858 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-a50d2323-dc2c-445a-9425-22970acc06bb tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:50:53.836492 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-a50d2323-dc2c-445a-9425-22970acc06bb tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:50:53.849892 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a50d2323-dc2c-445a-9425-22970acc06bb tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:50:53.850395 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a50d2323-dc2c-445a-9425-22970acc06bb tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:50:53.850849 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a50d2323-dc2c-445a-9425-22970acc06bb tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:50:53.857273 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a50d2323-dc2c-445a-9425-22970acc06bb tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:50:53.861266 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a50d2323-dc2c-445a-9425-22970acc06bb tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:50:53.862558 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a50d2323-dc2c-445a-9425-22970acc06bb tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:50:54.271393 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-f17e973f-285c-4be2-8ad4-1e6079d31584 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:50:54.272096 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-f17e973f-285c-4be2-8ad4-1e6079d31584 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:50:54.282660 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f17e973f-285c-4be2-8ad4-1e6079d31584 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:50:54.283659 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f17e973f-285c-4be2-8ad4-1e6079d31584 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:50:54.285621 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f17e973f-285c-4be2-8ad4-1e6079d31584 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:50:54.287696 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f17e973f-285c-4be2-8ad4-1e6079d31584 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:50:54.288542 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f17e973f-285c-4be2-8ad4-1e6079d31584 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:50:54.289257 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f17e973f-285c-4be2-8ad4-1e6079d31584 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:50:54.392190 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-a50d2323-dc2c-445a-9425-22970acc06bb tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:50:54.413391 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-a50d2323-dc2c-445a-9425-22970acc06bb tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1282 microversion: 2.1 time: 0.595709 Sep 16 09:50:54.419016 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 16/35] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:50:53 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1282 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:50:54.683563 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-4e6be9ff-9c71-444b-98cf-71b5b1635de0 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:50:54.684772 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-4e6be9ff-9c71-444b-98cf-71b5b1635de0 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] [instance: 480def5d-9bba-44e0-a53c-65239a428e1c] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:50:54.707086 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4e6be9ff-9c71-444b-98cf-71b5b1635de0 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:50:54.707603 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4e6be9ff-9c71-444b-98cf-71b5b1635de0 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:50:54.708049 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4e6be9ff-9c71-444b-98cf-71b5b1635de0 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:50:54.716753 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4e6be9ff-9c71-444b-98cf-71b5b1635de0 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:50:54.724903 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4e6be9ff-9c71-444b-98cf-71b5b1635de0 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:50:54.725677 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4e6be9ff-9c71-444b-98cf-71b5b1635de0 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:50:54.957093 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-4e6be9ff-9c71-444b-98cf-71b5b1635de0 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807093ae546a4e42a21c2755f49abc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cca830d4d9384e99b6f499a457776de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:50:54.976675 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-4e6be9ff-9c71-444b-98cf-71b5b1635de0 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] 10.222.0.73 "GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c" status: 200 len: 1273 microversion: 2.1 time: 0.296909 Sep 16 09:50:54.983168 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 17/36] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:50:54 2022] GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c => generated 1273 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:50:55.009445 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-19e14145-44d4-4d6e-8b6b-328b599d0f29 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:50:55.010543 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-19e14145-44d4-4d6e-8b6b-328b599d0f29 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: efec4ecb-65e7-4ca8-a29f-b87bc9ee1915] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:50:55.382649 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f17e973f-285c-4be2-8ad4-1e6079d31584 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:50:55.408565 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f17e973f-285c-4be2-8ad4-1e6079d31584 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:50:55.414966 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f17e973f-285c-4be2-8ad4-1e6079d31584 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:50:55.419455 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-f17e973f-285c-4be2-8ad4-1e6079d31584 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1332 microversion: 2.20 time: 1.152806 Sep 16 09:50:55.421056 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 20/37] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:50:54 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1332 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 09:50:55.449899 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-f5732e83-c4a5-4cd1-b54c-9c48dc6a1e18 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:50:55.454665 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-f5732e83-c4a5-4cd1-b54c-9c48dc6a1e18 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:50:55.478938 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f5732e83-c4a5-4cd1-b54c-9c48dc6a1e18 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:50:55.479825 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f5732e83-c4a5-4cd1-b54c-9c48dc6a1e18 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:50:55.482170 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f5732e83-c4a5-4cd1-b54c-9c48dc6a1e18 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:50:55.483114 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f5732e83-c4a5-4cd1-b54c-9c48dc6a1e18 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:50:55.487141 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f5732e83-c4a5-4cd1-b54c-9c48dc6a1e18 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:50:55.487805 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f5732e83-c4a5-4cd1-b54c-9c48dc6a1e18 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:50:55.768187 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-19e14145-44d4-4d6e-8b6b-328b599d0f29 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:50:55.783990 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-19e14145-44d4-4d6e-8b6b-328b599d0f29 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915" status: 200 len: 1241 microversion: 2.1 time: 0.795761 Sep 16 09:50:55.785894 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 18/38] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:50:54 2022] GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 => generated 1241 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:50:55.804843 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f5732e83-c4a5-4cd1-b54c-9c48dc6a1e18 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:50:55.827401 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-f5732e83-c4a5-4cd1-b54c-9c48dc6a1e18 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1280 microversion: 2.1 time: 0.382851 Sep 16 09:50:55.833455 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 21/39] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:50:55 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1280 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:50:56.008080 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-c4bb25e1-e077-488b-97d7-dad49f37640a tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:50:56.008722 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-c4bb25e1-e077-488b-97d7-dad49f37640a tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] [instance: 480def5d-9bba-44e0-a53c-65239a428e1c] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:50:56.031051 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c4bb25e1-e077-488b-97d7-dad49f37640a tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:50:56.031193 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c4bb25e1-e077-488b-97d7-dad49f37640a tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:50:56.031648 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c4bb25e1-e077-488b-97d7-dad49f37640a tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:50:56.032461 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c4bb25e1-e077-488b-97d7-dad49f37640a tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:50:56.041348 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c4bb25e1-e077-488b-97d7-dad49f37640a tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:50:56.043519 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c4bb25e1-e077-488b-97d7-dad49f37640a tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:50:56.234310 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-c4bb25e1-e077-488b-97d7-dad49f37640a tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807093ae546a4e42a21c2755f49abc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cca830d4d9384e99b6f499a457776de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:50:56.249156 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-c4bb25e1-e077-488b-97d7-dad49f37640a tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] 10.222.0.73 "GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c" status: 200 len: 1273 microversion: 2.1 time: 0.246091 Sep 16 09:50:56.251193 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 19/40] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:50:56 2022] GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c => generated 1273 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:50:56.451781 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-7cfaa454-beb7-47f6-af1e-b8156fe1c84d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:50:56.453000 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-7cfaa454-beb7-47f6-af1e-b8156fe1c84d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:50:56.476178 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7cfaa454-beb7-47f6-af1e-b8156fe1c84d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:50:56.478071 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7cfaa454-beb7-47f6-af1e-b8156fe1c84d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:50:56.480176 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7cfaa454-beb7-47f6-af1e-b8156fe1c84d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:50:56.481514 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7cfaa454-beb7-47f6-af1e-b8156fe1c84d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:50:56.482135 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7cfaa454-beb7-47f6-af1e-b8156fe1c84d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:50:56.487500 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7cfaa454-beb7-47f6-af1e-b8156fe1c84d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:50:56.814323 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-79349533-defd-46fa-b89f-9007c20a3c9d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:50:56.815556 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-79349533-defd-46fa-b89f-9007c20a3c9d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: efec4ecb-65e7-4ca8-a29f-b87bc9ee1915] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:50:56.828645 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-79349533-defd-46fa-b89f-9007c20a3c9d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:50:56.829941 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-79349533-defd-46fa-b89f-9007c20a3c9d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:50:56.831943 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-79349533-defd-46fa-b89f-9007c20a3c9d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:50:56.832910 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-79349533-defd-46fa-b89f-9007c20a3c9d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:50:56.836123 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-79349533-defd-46fa-b89f-9007c20a3c9d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:50:56.837196 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-79349533-defd-46fa-b89f-9007c20a3c9d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:50:56.992113 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-7cfaa454-beb7-47f6-af1e-b8156fe1c84d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:50:57.002089 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-7cfaa454-beb7-47f6-af1e-b8156fe1c84d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:50:57.013177 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-7cfaa454-beb7-47f6-af1e-b8156fe1c84d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:50:57.013177 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-7cfaa454-beb7-47f6-af1e-b8156fe1c84d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1338 microversion: 2.20 time: 0.564958 Sep 16 09:50:57.013349 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 22/41] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:50:56 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1338 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:50:57.050231 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-b8efe243-067d-4199-a563-3c6c8ce38366 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:50:57.051459 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-b8efe243-067d-4199-a563-3c6c8ce38366 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:50:57.068948 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b8efe243-067d-4199-a563-3c6c8ce38366 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:50:57.076931 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b8efe243-067d-4199-a563-3c6c8ce38366 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:50:57.077678 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b8efe243-067d-4199-a563-3c6c8ce38366 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:50:57.085403 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b8efe243-067d-4199-a563-3c6c8ce38366 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:50:57.086099 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b8efe243-067d-4199-a563-3c6c8ce38366 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:50:57.086715 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b8efe243-067d-4199-a563-3c6c8ce38366 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:50:57.157391 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-79349533-defd-46fa-b89f-9007c20a3c9d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:50:57.171799 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-79349533-defd-46fa-b89f-9007c20a3c9d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915" status: 200 len: 1293 microversion: 2.1 time: 0.361480 Sep 16 09:50:57.182055 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 20/42] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:50:56 2022] GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 => generated 1293 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:50:57.277126 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-d7744c55-9bae-4a18-89cb-3fcb60f49e6a tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:50:57.278241 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-d7744c55-9bae-4a18-89cb-3fcb60f49e6a tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] [instance: 480def5d-9bba-44e0-a53c-65239a428e1c] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:50:57.300327 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d7744c55-9bae-4a18-89cb-3fcb60f49e6a tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:50:57.300936 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d7744c55-9bae-4a18-89cb-3fcb60f49e6a tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:50:57.301584 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d7744c55-9bae-4a18-89cb-3fcb60f49e6a tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:50:57.302354 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d7744c55-9bae-4a18-89cb-3fcb60f49e6a tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:50:57.302813 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d7744c55-9bae-4a18-89cb-3fcb60f49e6a tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:50:57.303247 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d7744c55-9bae-4a18-89cb-3fcb60f49e6a tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:50:57.396438 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-b8efe243-067d-4199-a563-3c6c8ce38366 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:50:57.411939 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-b8efe243-067d-4199-a563-3c6c8ce38366 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1280 microversion: 2.1 time: 0.397383 Sep 16 09:50:57.412638 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 23/43] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:50:57 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1280 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:50:58.043024 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-6f8af1a8-4c3d-478d-9f45-6dfa28f5c557 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:50:58.043696 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-d7744c55-9bae-4a18-89cb-3fcb60f49e6a tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807093ae546a4e42a21c2755f49abc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cca830d4d9384e99b6f499a457776de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:50:58.044103 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-6f8af1a8-4c3d-478d-9f45-6dfa28f5c557 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:50:58.059615 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6f8af1a8-4c3d-478d-9f45-6dfa28f5c557 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:50:58.060126 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6f8af1a8-4c3d-478d-9f45-6dfa28f5c557 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:50:58.060572 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6f8af1a8-4c3d-478d-9f45-6dfa28f5c557 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:50:58.064417 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6f8af1a8-4c3d-478d-9f45-6dfa28f5c557 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:50:58.067421 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6f8af1a8-4c3d-478d-9f45-6dfa28f5c557 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:50:58.068870 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6f8af1a8-4c3d-478d-9f45-6dfa28f5c557 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:50:58.069025 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-d7744c55-9bae-4a18-89cb-3fcb60f49e6a tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] 10.222.0.73 "GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c" status: 200 len: 1315 microversion: 2.1 time: 0.800115 Sep 16 09:50:58.069656 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 21/44] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:50:57 2022] GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c => generated 1315 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:50:58.210477 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-6e1220ff-cc7a-4a36-a26a-432dbb1cbbe2 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:50:58.213460 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-6e1220ff-cc7a-4a36-a26a-432dbb1cbbe2 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: efec4ecb-65e7-4ca8-a29f-b87bc9ee1915] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:50:58.227416 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6e1220ff-cc7a-4a36-a26a-432dbb1cbbe2 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:50:58.228073 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6e1220ff-cc7a-4a36-a26a-432dbb1cbbe2 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:50:58.230852 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6e1220ff-cc7a-4a36-a26a-432dbb1cbbe2 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:50:58.233147 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6e1220ff-cc7a-4a36-a26a-432dbb1cbbe2 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:50:58.239070 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6e1220ff-cc7a-4a36-a26a-432dbb1cbbe2 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:50:58.239596 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6e1220ff-cc7a-4a36-a26a-432dbb1cbbe2 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:50:58.633005 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-6f8af1a8-4c3d-478d-9f45-6dfa28f5c557 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:50:58.674904 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-6f8af1a8-4c3d-478d-9f45-6dfa28f5c557 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:50:58.684696 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-6e1220ff-cc7a-4a36-a26a-432dbb1cbbe2 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:50:58.684967 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-6f8af1a8-4c3d-478d-9f45-6dfa28f5c557 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:50:58.686841 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-6f8af1a8-4c3d-478d-9f45-6dfa28f5c557 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1338 microversion: 2.20 time: 0.648220 Sep 16 09:50:58.713232 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-6e1220ff-cc7a-4a36-a26a-432dbb1cbbe2 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915" status: 200 len: 1301 microversion: 2.1 time: 0.508476 Sep 16 09:50:58.714663 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 24/45] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:50:58 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1338 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 09:50:58.725554 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-3eb7ece6-5065-4156-8b1a-6f84973f6ba6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:50:58.728308 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 22/46] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:50:58 2022] GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 => generated 1301 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:50:58.734361 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-3eb7ece6-5065-4156-8b1a-6f84973f6ba6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:50:58.762219 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:50:58.774365 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3eb7ece6-5065-4156-8b1a-6f84973f6ba6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:50:58.776016 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3eb7ece6-5065-4156-8b1a-6f84973f6ba6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:50:58.777197 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3eb7ece6-5065-4156-8b1a-6f84973f6ba6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:50:58.781484 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3eb7ece6-5065-4156-8b1a-6f84973f6ba6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:50:58.783202 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3eb7ece6-5065-4156-8b1a-6f84973f6ba6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:50:58.786230 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3eb7ece6-5065-4156-8b1a-6f84973f6ba6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:50:59.096434 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-3eb35300-8814-4e04-980d-abd8678182ff tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:50:59.097063 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-3eb35300-8814-4e04-980d-abd8678182ff tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] [instance: 480def5d-9bba-44e0-a53c-65239a428e1c] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:50:59.109400 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3eb35300-8814-4e04-980d-abd8678182ff tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:50:59.109949 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3eb35300-8814-4e04-980d-abd8678182ff tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:50:59.110404 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3eb35300-8814-4e04-980d-abd8678182ff tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:50:59.111112 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3eb35300-8814-4e04-980d-abd8678182ff tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:50:59.111574 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3eb35300-8814-4e04-980d-abd8678182ff tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:50:59.112008 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3eb35300-8814-4e04-980d-abd8678182ff tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:50:59.133765 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-3eb7ece6-5065-4156-8b1a-6f84973f6ba6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:50:59.142900 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-3eb7ece6-5065-4156-8b1a-6f84973f6ba6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1280 microversion: 2.1 time: 0.426948 Sep 16 09:50:59.143498 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 25/47] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:50:58 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1280 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:50:59.287076 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell0:SELECT=4 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:50:59.722825 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-c1a77ef7-48a7-4619-a31c-aa11884cdb02 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:50:59.722825 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-c1a77ef7-48a7-4619-a31c-aa11884cdb02 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:50:59.745164 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c1a77ef7-48a7-4619-a31c-aa11884cdb02 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:50:59.746860 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c1a77ef7-48a7-4619-a31c-aa11884cdb02 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:50:59.746860 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c1a77ef7-48a7-4619-a31c-aa11884cdb02 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:50:59.746860 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c1a77ef7-48a7-4619-a31c-aa11884cdb02 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:50:59.747320 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c1a77ef7-48a7-4619-a31c-aa11884cdb02 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:50:59.747765 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c1a77ef7-48a7-4619-a31c-aa11884cdb02 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:50:59.920782 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-3eb35300-8814-4e04-980d-abd8678182ff tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807093ae546a4e42a21c2755f49abc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cca830d4d9384e99b6f499a457776de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:50:59.941204 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-3eb35300-8814-4e04-980d-abd8678182ff tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] 10.222.0.73 "GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c" status: 200 len: 1315 microversion: 2.1 time: 0.840927 Sep 16 09:50:59.942405 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 23/48] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:50:59 2022] GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c => generated 1315 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:50:59.963638 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-3ae4495e-d098-4dc4-bcbd-471ab4e359d8 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:50:59.967481 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-3ae4495e-d098-4dc4-bcbd-471ab4e359d8 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: efec4ecb-65e7-4ca8-a29f-b87bc9ee1915] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:50:59.972740 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3ae4495e-d098-4dc4-bcbd-471ab4e359d8 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:50:59.973877 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3ae4495e-d098-4dc4-bcbd-471ab4e359d8 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:50:59.975128 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3ae4495e-d098-4dc4-bcbd-471ab4e359d8 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:50:59.976017 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3ae4495e-d098-4dc4-bcbd-471ab4e359d8 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:50:59.978816 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3ae4495e-d098-4dc4-bcbd-471ab4e359d8 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:50:59.979588 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3ae4495e-d098-4dc4-bcbd-471ab4e359d8 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:00.166741 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-3ae4495e-d098-4dc4-bcbd-471ab4e359d8 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:00.185710 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-3ae4495e-d098-4dc4-bcbd-471ab4e359d8 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915" status: 200 len: 1299 microversion: 2.1 time: 0.231281 Sep 16 09:51:00.185710 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 24/49] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:50:59 2022] GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 => generated 1299 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:00.200912 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-c72ae1de-bc12-4a0d-b4ed-9e2291f0e739 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:00.203480 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-c72ae1de-bc12-4a0d-b4ed-9e2291f0e739 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:00.229855 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c72ae1de-bc12-4a0d-b4ed-9e2291f0e739 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:00.231936 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c72ae1de-bc12-4a0d-b4ed-9e2291f0e739 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:00.233034 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c72ae1de-bc12-4a0d-b4ed-9e2291f0e739 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:00.237319 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c72ae1de-bc12-4a0d-b4ed-9e2291f0e739 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:00.237319 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c72ae1de-bc12-4a0d-b4ed-9e2291f0e739 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:00.237319 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c72ae1de-bc12-4a0d-b4ed-9e2291f0e739 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:01.098373 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c1a77ef7-48a7-4619-a31c-aa11884cdb02 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:01.138097 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c1a77ef7-48a7-4619-a31c-aa11884cdb02 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:01.138097 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c1a77ef7-48a7-4619-a31c-aa11884cdb02 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:01.138097 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-c1a77ef7-48a7-4619-a31c-aa11884cdb02 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1403 microversion: 2.20 time: 1.405791 Sep 16 09:51:01.138758 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 26/50] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:50:59 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1403 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 09:51:01.159637 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-ba0d3cbf-c61e-4e0e-a962-9adbd1f2ee5f tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:01.165533 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-ba0d3cbf-c61e-4e0e-a962-9adbd1f2ee5f tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] [instance: 480def5d-9bba-44e0-a53c-65239a428e1c] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:01.188919 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ba0d3cbf-c61e-4e0e-a962-9adbd1f2ee5f tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:01.189425 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ba0d3cbf-c61e-4e0e-a962-9adbd1f2ee5f tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:01.189935 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ba0d3cbf-c61e-4e0e-a962-9adbd1f2ee5f tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:01.190653 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ba0d3cbf-c61e-4e0e-a962-9adbd1f2ee5f tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:01.191113 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ba0d3cbf-c61e-4e0e-a962-9adbd1f2ee5f tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:01.191548 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ba0d3cbf-c61e-4e0e-a962-9adbd1f2ee5f tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:01.295901 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-c72ae1de-bc12-4a0d-b4ed-9e2291f0e739 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:01.339223 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-c72ae1de-bc12-4a0d-b4ed-9e2291f0e739 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1322 microversion: 2.1 time: 1.133737 Sep 16 09:51:01.343580 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 25/51] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:00 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1322 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:01.386135 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-5c6c332c-1ac2-4dae-8f77-31b70d56a65a tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:01.387034 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-5c6c332c-1ac2-4dae-8f77-31b70d56a65a tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: efec4ecb-65e7-4ca8-a29f-b87bc9ee1915] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:01.397258 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5c6c332c-1ac2-4dae-8f77-31b70d56a65a tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:01.398077 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5c6c332c-1ac2-4dae-8f77-31b70d56a65a tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:01.398980 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5c6c332c-1ac2-4dae-8f77-31b70d56a65a tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:01.400021 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5c6c332c-1ac2-4dae-8f77-31b70d56a65a tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:01.400870 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5c6c332c-1ac2-4dae-8f77-31b70d56a65a tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:01.414094 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5c6c332c-1ac2-4dae-8f77-31b70d56a65a tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:01.849657 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-ba0d3cbf-c61e-4e0e-a962-9adbd1f2ee5f tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807093ae546a4e42a21c2755f49abc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cca830d4d9384e99b6f499a457776de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:01.859331 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-ba0d3cbf-c61e-4e0e-a962-9adbd1f2ee5f tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] 10.222.0.73 "GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c" status: 200 len: 1315 microversion: 2.1 time: 0.732164 Sep 16 09:51:01.864628 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 27/52] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:01 2022] GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c => generated 1315 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:01.881458 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-5c6c332c-1ac2-4dae-8f77-31b70d56a65a tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:01.904174 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-5c6c332c-1ac2-4dae-8f77-31b70d56a65a tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915" status: 200 len: 1299 microversion: 2.1 time: 0.559005 Sep 16 09:51:01.905293 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 26/53] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:01 2022] GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 => generated 1299 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:02.155197 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-4b994730-d2a1-4072-951c-ba2d67a9e273 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:02.156466 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-4b994730-d2a1-4072-951c-ba2d67a9e273 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:02.175348 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4b994730-d2a1-4072-951c-ba2d67a9e273 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:02.181713 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4b994730-d2a1-4072-951c-ba2d67a9e273 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:02.182990 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4b994730-d2a1-4072-951c-ba2d67a9e273 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:02.184481 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4b994730-d2a1-4072-951c-ba2d67a9e273 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:02.185601 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4b994730-d2a1-4072-951c-ba2d67a9e273 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:02.186531 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4b994730-d2a1-4072-951c-ba2d67a9e273 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:02.373312 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-3f1f9c7f-9686-434c-b0d4-bad9da654f06 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:02.374119 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-3f1f9c7f-9686-434c-b0d4-bad9da654f06 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:02.390437 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3f1f9c7f-9686-434c-b0d4-bad9da654f06 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:02.391542 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3f1f9c7f-9686-434c-b0d4-bad9da654f06 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:02.394536 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3f1f9c7f-9686-434c-b0d4-bad9da654f06 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:02.395430 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3f1f9c7f-9686-434c-b0d4-bad9da654f06 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:02.396096 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3f1f9c7f-9686-434c-b0d4-bad9da654f06 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:02.397147 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3f1f9c7f-9686-434c-b0d4-bad9da654f06 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:02.701457 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-3f1f9c7f-9686-434c-b0d4-bad9da654f06 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:02.715677 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-3f1f9c7f-9686-434c-b0d4-bad9da654f06 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1322 microversion: 2.1 time: 0.345502 Sep 16 09:51:02.731227 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 27/54] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:02 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1322 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:51:02.845280 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-4b994730-d2a1-4072-951c-ba2d67a9e273 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:02.862964 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-4b994730-d2a1-4072-951c-ba2d67a9e273 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:02.862964 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-4b994730-d2a1-4072-951c-ba2d67a9e273 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:02.865586 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-4b994730-d2a1-4072-951c-ba2d67a9e273 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1403 microversion: 2.20 time: 0.716455 Sep 16 09:51:02.881900 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 28/55] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:51:02 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1403 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:51:02.890925 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-89cc2c29-2e21-4513-8cef-15634a5658a6 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:02.890925 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-89cc2c29-2e21-4513-8cef-15634a5658a6 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] [instance: 480def5d-9bba-44e0-a53c-65239a428e1c] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:02.899367 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-89cc2c29-2e21-4513-8cef-15634a5658a6 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:02.900126 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-89cc2c29-2e21-4513-8cef-15634a5658a6 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:02.900766 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-89cc2c29-2e21-4513-8cef-15634a5658a6 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:02.902651 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-89cc2c29-2e21-4513-8cef-15634a5658a6 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:02.910340 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-89cc2c29-2e21-4513-8cef-15634a5658a6 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:02.910796 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-89cc2c29-2e21-4513-8cef-15634a5658a6 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:02.932420 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-c861cce7-f864-4f5c-888d-8baa51777f20 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:02.933514 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-c861cce7-f864-4f5c-888d-8baa51777f20 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: efec4ecb-65e7-4ca8-a29f-b87bc9ee1915] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:02.943249 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c861cce7-f864-4f5c-888d-8baa51777f20 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:02.944303 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c861cce7-f864-4f5c-888d-8baa51777f20 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:02.946837 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c861cce7-f864-4f5c-888d-8baa51777f20 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:02.949467 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c861cce7-f864-4f5c-888d-8baa51777f20 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:02.950653 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c861cce7-f864-4f5c-888d-8baa51777f20 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:02.952941 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c861cce7-f864-4f5c-888d-8baa51777f20 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:03.155148 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell0:SELECT=6 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:51:03.200363 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-89cc2c29-2e21-4513-8cef-15634a5658a6 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807093ae546a4e42a21c2755f49abc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cca830d4d9384e99b6f499a457776de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:03.212542 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell1:SELECT=100 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:51:03.219195 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-89cc2c29-2e21-4513-8cef-15634a5658a6 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] 10.222.0.73 "GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c" status: 200 len: 1315 microversion: 2.1 time: 0.332843 Sep 16 09:51:03.238611 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 28/56] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:02 2022] GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c => generated 1315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:03.465353 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c861cce7-f864-4f5c-888d-8baa51777f20 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:03.482767 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-c861cce7-f864-4f5c-888d-8baa51777f20 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915" status: 200 len: 1366 microversion: 2.1 time: 0.554777 Sep 16 09:51:03.485110 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 29/57] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:02 2022] GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 => generated 1366 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:51:03.656089 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-faf02952-77f8-4b57-b5b8-bb3ae1d67b31 req-9f4deefa-79e7-406d-90ea-9f716aa53ca4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f634aa6d-e24c-48df-946f-3166fd76273a", "tag": "2959b5a1-1a1a-4ce9-93ab-cb413d960925"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:51:03.657944 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [req-47f67eb4-a5b8-4dce-8e91-e6e77f34b366 req-00d56e2d-7264-4345-8c9e-997f9ca0eb06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "480def5d-9bba-44e0-a53c-65239a428e1c", "tag": "c050f3bc-122c-4343-b68a-ba8664cb732b"}]} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:51:03.670401 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-faf02952-77f8-4b57-b5b8-bb3ae1d67b31 req-9f4deefa-79e7-406d-90ea-9f716aa53ca4 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:03.670993 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-faf02952-77f8-4b57-b5b8-bb3ae1d67b31 req-9f4deefa-79e7-406d-90ea-9f716aa53ca4 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:03.671359 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-faf02952-77f8-4b57-b5b8-bb3ae1d67b31 req-9f4deefa-79e7-406d-90ea-9f716aa53ca4 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:03.671793 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-47f67eb4-a5b8-4dce-8e91-e6e77f34b366 req-00d56e2d-7264-4345-8c9e-997f9ca0eb06 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:03.672349 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-47f67eb4-a5b8-4dce-8e91-e6e77f34b366 req-00d56e2d-7264-4345-8c9e-997f9ca0eb06 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:03.672850 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-47f67eb4-a5b8-4dce-8e91-e6e77f34b366 req-00d56e2d-7264-4345-8c9e-997f9ca0eb06 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:03.694320 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-faf02952-77f8-4b57-b5b8-bb3ae1d67b31 req-9f4deefa-79e7-406d-90ea-9f716aa53ca4 service nova] Creating event network-changed:2959b5a1-1a1a-4ce9-93ab-cb413d960925 for instance f634aa6d-e24c-48df-946f-3166fd76273a on hv-cinder-79053 Sep 16 09:51:03.695384 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-faf02952-77f8-4b57-b5b8-bb3ae1d67b31 req-9f4deefa-79e7-406d-90ea-9f716aa53ca4 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127670) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 16 09:51:03.695772 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.compute.server_external_events [req-47f67eb4-a5b8-4dce-8e91-e6e77f34b366 req-00d56e2d-7264-4345-8c9e-997f9ca0eb06 service nova] Creating event network-changed:c050f3bc-122c-4343-b68a-ba8664cb732b for instance 480def5d-9bba-44e0-a53c-65239a428e1c on hv-cinder-79053 Sep 16 09:51:03.696182 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-faf02952-77f8-4b57-b5b8-bb3ae1d67b31 req-9f4deefa-79e7-406d-90ea-9f716aa53ca4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127670) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 16 09:51:03.696298 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-47f67eb4-a5b8-4dce-8e91-e6e77f34b366 req-00d56e2d-7264-4345-8c9e-997f9ca0eb06 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127671) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 16 09:51:03.696693 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-47f67eb4-a5b8-4dce-8e91-e6e77f34b366 req-00d56e2d-7264-4345-8c9e-997f9ca0eb06 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127671) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 16 09:51:03.698099 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1670127f-d2dd-4baa-827c-54e5cde54bda None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:03.698537 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c6402af9-3b55-4d62-9102-8b157f208719 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:03.698643 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1670127f-d2dd-4baa-827c-54e5cde54bda None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:03.702437 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1670127f-d2dd-4baa-827c-54e5cde54bda None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:03.702570 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c6402af9-3b55-4d62-9102-8b157f208719 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:03.702649 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1670127f-d2dd-4baa-827c-54e5cde54bda None None] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:03.702773 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c6402af9-3b55-4d62-9102-8b157f208719 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:03.702862 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1670127f-d2dd-4baa-827c-54e5cde54bda None None] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:03.702862 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1670127f-d2dd-4baa-827c-54e5cde54bda None None] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:03.703058 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c6402af9-3b55-4d62-9102-8b157f208719 None None] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:03.703058 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c6402af9-3b55-4d62-9102-8b157f208719 None None] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:03.703058 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c6402af9-3b55-4d62-9102-8b157f208719 None None] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:03.711783 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.compute.rpcapi [None req-1670127f-d2dd-4baa-827c-54e5cde54bda None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 16 09:51:03.712703 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1670127f-d2dd-4baa-827c-54e5cde54bda None None] Releasing lock "compute-rpcapi-router" {{(pid=127671) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 16 09:51:03.712810 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.compute.rpcapi [None req-c6402af9-3b55-4d62-9102-8b157f208719 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 16 09:51:03.713973 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c6402af9-3b55-4d62-9102-8b157f208719 None None] Releasing lock "compute-rpcapi-router" {{(pid=127670) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 16 09:51:03.732720 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-1670127f-d2dd-4baa-827c-54e5cde54bda None None] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.493135 Sep 16 09:51:03.734349 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 29/58] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:51:03.735178 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-c6402af9-3b55-4d62-9102-8b157f208719 None None] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.173914 Sep 16 09:51:03.736065 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 30/59] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:51:03.754402 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-0eab7a15-0f89-485a-ae3b-dddedf2397be tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:03.754402 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-0eab7a15-0f89-485a-ae3b-dddedf2397be tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:03.755361 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-0eab7a15-0f89-485a-ae3b-dddedf2397be tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:03.756019 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-0eab7a15-0f89-485a-ae3b-dddedf2397be tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:03.756604 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-0eab7a15-0f89-485a-ae3b-dddedf2397be tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:03.757326 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-0eab7a15-0f89-485a-ae3b-dddedf2397be tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:03.757811 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-0eab7a15-0f89-485a-ae3b-dddedf2397be tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:03.758243 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-0eab7a15-0f89-485a-ae3b-dddedf2397be tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:03.906999 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-e861cd0f-c93b-4df3-a7cf-896f989a421e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:03.907797 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-e861cd0f-c93b-4df3-a7cf-896f989a421e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:03.916246 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell0:SELECT=32 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:51:03.918353 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e861cd0f-c93b-4df3-a7cf-896f989a421e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:03.919230 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e861cd0f-c93b-4df3-a7cf-896f989a421e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:03.928595 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e861cd0f-c93b-4df3-a7cf-896f989a421e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:03.928595 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e861cd0f-c93b-4df3-a7cf-896f989a421e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:03.928595 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e861cd0f-c93b-4df3-a7cf-896f989a421e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:03.928595 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e861cd0f-c93b-4df3-a7cf-896f989a421e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:03.966126 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-0eab7a15-0f89-485a-ae3b-dddedf2397be tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:03.975691 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-0eab7a15-0f89-485a-ae3b-dddedf2397be tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1322 microversion: 2.1 time: 0.235197 Sep 16 09:51:03.976275 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 30/60] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:03 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:04.167080 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-e861cd0f-c93b-4df3-a7cf-896f989a421e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:04.180705 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-e861cd0f-c93b-4df3-a7cf-896f989a421e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:04.182184 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-e861cd0f-c93b-4df3-a7cf-896f989a421e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:04.183353 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-e861cd0f-c93b-4df3-a7cf-896f989a421e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1403 microversion: 2.20 time: 0.290489 Sep 16 09:51:04.183918 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 31/61] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:51:03 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1403 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:51:04.248101 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-e3fe101e-c81a-4021-abe9-a68c0f767a16 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:04.248751 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-e3fe101e-c81a-4021-abe9-a68c0f767a16 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] [instance: 480def5d-9bba-44e0-a53c-65239a428e1c] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:04.256131 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e3fe101e-c81a-4021-abe9-a68c0f767a16 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:04.256742 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e3fe101e-c81a-4021-abe9-a68c0f767a16 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:04.257187 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e3fe101e-c81a-4021-abe9-a68c0f767a16 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:04.258232 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e3fe101e-c81a-4021-abe9-a68c0f767a16 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:04.258459 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e3fe101e-c81a-4021-abe9-a68c0f767a16 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:04.259006 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e3fe101e-c81a-4021-abe9-a68c0f767a16 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:04.409393 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-e3fe101e-c81a-4021-abe9-a68c0f767a16 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807093ae546a4e42a21c2755f49abc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cca830d4d9384e99b6f499a457776de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:04.417602 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-e3fe101e-c81a-4021-abe9-a68c0f767a16 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] 10.222.0.73 "GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c" status: 200 len: 1315 microversion: 2.1 time: 0.173461 Sep 16 09:51:04.418198 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 31/62] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:04 2022] GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:04.512021 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-c35e8ab8-48e6-4270-9428-c4d7f2bc638b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:04.512566 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-c35e8ab8-48e6-4270-9428-c4d7f2bc638b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: efec4ecb-65e7-4ca8-a29f-b87bc9ee1915] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:04.518632 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c35e8ab8-48e6-4270-9428-c4d7f2bc638b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:04.519121 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c35e8ab8-48e6-4270-9428-c4d7f2bc638b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:04.519563 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c35e8ab8-48e6-4270-9428-c4d7f2bc638b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:04.520260 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c35e8ab8-48e6-4270-9428-c4d7f2bc638b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:04.520818 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c35e8ab8-48e6-4270-9428-c4d7f2bc638b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:04.521501 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c35e8ab8-48e6-4270-9428-c4d7f2bc638b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:04.677732 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c35e8ab8-48e6-4270-9428-c4d7f2bc638b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:04.685707 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-c35e8ab8-48e6-4270-9428-c4d7f2bc638b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915" status: 200 len: 1366 microversion: 2.1 time: 0.177733 Sep 16 09:51:04.686771 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 32/63] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:04 2022] GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:05.005380 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-da541777-419f-4b75-a02f-b9f6d5d52322 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:05.006314 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-da541777-419f-4b75-a02f-b9f6d5d52322 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:05.012887 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-da541777-419f-4b75-a02f-b9f6d5d52322 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:05.013529 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-da541777-419f-4b75-a02f-b9f6d5d52322 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:05.014180 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-da541777-419f-4b75-a02f-b9f6d5d52322 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:05.014919 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-da541777-419f-4b75-a02f-b9f6d5d52322 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:05.015463 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-da541777-419f-4b75-a02f-b9f6d5d52322 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:05.015962 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-da541777-419f-4b75-a02f-b9f6d5d52322 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:05.169826 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-da541777-419f-4b75-a02f-b9f6d5d52322 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:05.179450 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-da541777-419f-4b75-a02f-b9f6d5d52322 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1322 microversion: 2.1 time: 0.182234 Sep 16 09:51:05.180035 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 32/64] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:04 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:05.209522 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-3fada92b-80c7-462f-b365-af3e47242593 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:05.210570 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-3fada92b-80c7-462f-b365-af3e47242593 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:05.217783 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3fada92b-80c7-462f-b365-af3e47242593 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:05.218590 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3fada92b-80c7-462f-b365-af3e47242593 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:05.219272 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3fada92b-80c7-462f-b365-af3e47242593 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:05.220234 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3fada92b-80c7-462f-b365-af3e47242593 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:05.220696 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3fada92b-80c7-462f-b365-af3e47242593 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:05.221224 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3fada92b-80c7-462f-b365-af3e47242593 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:05.441742 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-bfd70442-38e5-4c6a-a87f-ca448c66db26 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:05.442571 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-bfd70442-38e5-4c6a-a87f-ca448c66db26 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] [instance: 480def5d-9bba-44e0-a53c-65239a428e1c] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:05.451651 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-bfd70442-38e5-4c6a-a87f-ca448c66db26 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:05.459668 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-bfd70442-38e5-4c6a-a87f-ca448c66db26 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:05.460159 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-bfd70442-38e5-4c6a-a87f-ca448c66db26 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:05.461110 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-bfd70442-38e5-4c6a-a87f-ca448c66db26 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:05.461800 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-bfd70442-38e5-4c6a-a87f-ca448c66db26 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:05.462304 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-bfd70442-38e5-4c6a-a87f-ca448c66db26 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:05.606334 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-3fada92b-80c7-462f-b365-af3e47242593 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:05.618343 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-3fada92b-80c7-462f-b365-af3e47242593 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:05.620437 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-3fada92b-80c7-462f-b365-af3e47242593 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:05.621939 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-3fada92b-80c7-462f-b365-af3e47242593 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1403 microversion: 2.20 time: 0.417424 Sep 16 09:51:05.634755 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 33/65] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:51:05 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1403 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 09:51:05.653832 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-bfd70442-38e5-4c6a-a87f-ca448c66db26 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807093ae546a4e42a21c2755f49abc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cca830d4d9384e99b6f499a457776de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:05.662303 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-bfd70442-38e5-4c6a-a87f-ca448c66db26 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] 10.222.0.73 "GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c" status: 200 len: 1315 microversion: 2.1 time: 0.224528 Sep 16 09:51:05.663135 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 33/66] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:05 2022] GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:51:05.711392 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-ccb00644-39f4-4fdd-91a2-e08bf8500bd5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:05.712020 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-ccb00644-39f4-4fdd-91a2-e08bf8500bd5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: efec4ecb-65e7-4ca8-a29f-b87bc9ee1915] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:05.730866 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ccb00644-39f4-4fdd-91a2-e08bf8500bd5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:05.731387 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ccb00644-39f4-4fdd-91a2-e08bf8500bd5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:05.731955 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ccb00644-39f4-4fdd-91a2-e08bf8500bd5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:05.732612 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ccb00644-39f4-4fdd-91a2-e08bf8500bd5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:05.733035 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ccb00644-39f4-4fdd-91a2-e08bf8500bd5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:05.733479 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ccb00644-39f4-4fdd-91a2-e08bf8500bd5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:05.756713 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [req-a4047c76-d903-4163-bf91-216ba028b2f3 req-928bcfc7-c869-4bf9-bada-d3a664255dd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6f3fc30-e196-4427-90b4-5d49b56a9b46", "tag": "10ea483a-6487-40ad-8b75-adc32be4973b"}, {"name": "network-changed", "server_uuid": "88a0813e-ace7-48df-b688-533c8dbc81de", "tag": "55883b34-2ac0-4ba3-b4af-c5503b0d8fc9"}]} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:51:05.784543 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell0:SELECT=24 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:51:05.786144 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:51:05.789325 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-a4047c76-d903-4163-bf91-216ba028b2f3 req-928bcfc7-c869-4bf9-bada-d3a664255dd5 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:05.790215 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-a4047c76-d903-4163-bf91-216ba028b2f3 req-928bcfc7-c869-4bf9-bada-d3a664255dd5 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:05.792542 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-a4047c76-d903-4163-bf91-216ba028b2f3 req-928bcfc7-c869-4bf9-bada-d3a664255dd5 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:05.842090 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.compute.server_external_events [req-a4047c76-d903-4163-bf91-216ba028b2f3 req-928bcfc7-c869-4bf9-bada-d3a664255dd5 service nova] Creating event network-changed:10ea483a-6487-40ad-8b75-adc32be4973b for instance a6f3fc30-e196-4427-90b4-5d49b56a9b46 on hv-cinder-79053 Sep 16 09:51:05.842858 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.compute.server_external_events [req-a4047c76-d903-4163-bf91-216ba028b2f3 req-928bcfc7-c869-4bf9-bada-d3a664255dd5 service nova] Creating event network-changed:55883b34-2ac0-4ba3-b4af-c5503b0d8fc9 for instance 88a0813e-ace7-48df-b688-533c8dbc81de on hv-cinder-79053 Sep 16 09:51:05.861032 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [req-a4047c76-d903-4163-bf91-216ba028b2f3 req-928bcfc7-c869-4bf9-bada-d3a664255dd5 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.108602 Sep 16 09:51:05.861617 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 34/67] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:51:05.937285 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-ccb00644-39f4-4fdd-91a2-e08bf8500bd5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:05.955761 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-ccb00644-39f4-4fdd-91a2-e08bf8500bd5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915" status: 200 len: 1366 microversion: 2.1 time: 0.249308 Sep 16 09:51:05.956458 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 34/68] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:05 2022] GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:51:06.207001 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-3b477d35-f8a3-44cd-a92d-d7d867afa3ea tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:06.207726 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-3b477d35-f8a3-44cd-a92d-d7d867afa3ea tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:06.218869 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3b477d35-f8a3-44cd-a92d-d7d867afa3ea tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:06.221126 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3b477d35-f8a3-44cd-a92d-d7d867afa3ea tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:06.221126 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3b477d35-f8a3-44cd-a92d-d7d867afa3ea tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:06.221796 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3b477d35-f8a3-44cd-a92d-d7d867afa3ea tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:06.222311 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3b477d35-f8a3-44cd-a92d-d7d867afa3ea tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:06.222985 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3b477d35-f8a3-44cd-a92d-d7d867afa3ea tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:06.425616 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-3b477d35-f8a3-44cd-a92d-d7d867afa3ea tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:06.434505 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-3b477d35-f8a3-44cd-a92d-d7d867afa3ea tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1322 microversion: 2.1 time: 0.233529 Sep 16 09:51:06.435200 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 35/69] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:06 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:06.654207 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d2c66b3d-585f-4332-a05b-dd7ff68cf4b0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:06.655666 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-d2c66b3d-585f-4332-a05b-dd7ff68cf4b0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:06.665787 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d2c66b3d-585f-4332-a05b-dd7ff68cf4b0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:06.666469 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d2c66b3d-585f-4332-a05b-dd7ff68cf4b0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:06.667150 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d2c66b3d-585f-4332-a05b-dd7ff68cf4b0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:06.668147 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d2c66b3d-585f-4332-a05b-dd7ff68cf4b0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:06.668842 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d2c66b3d-585f-4332-a05b-dd7ff68cf4b0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:06.669272 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d2c66b3d-585f-4332-a05b-dd7ff68cf4b0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:06.685456 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-3290bff5-dadd-461f-a793-99d1320d010b tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:06.686325 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-3290bff5-dadd-461f-a793-99d1320d010b tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] [instance: 480def5d-9bba-44e0-a53c-65239a428e1c] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:06.698738 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3290bff5-dadd-461f-a793-99d1320d010b tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:06.699267 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3290bff5-dadd-461f-a793-99d1320d010b tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:06.701142 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3290bff5-dadd-461f-a793-99d1320d010b tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:06.703569 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3290bff5-dadd-461f-a793-99d1320d010b tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:06.704129 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3290bff5-dadd-461f-a793-99d1320d010b tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:06.705973 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3290bff5-dadd-461f-a793-99d1320d010b tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:06.853744 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-d2c66b3d-585f-4332-a05b-dd7ff68cf4b0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:06.858504 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=100 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:51:06.867587 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-d2c66b3d-585f-4332-a05b-dd7ff68cf4b0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:06.869831 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-d2c66b3d-585f-4332-a05b-dd7ff68cf4b0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:06.871482 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-d2c66b3d-585f-4332-a05b-dd7ff68cf4b0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1403 microversion: 2.20 time: 0.221781 Sep 16 09:51:06.874915 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 35/70] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:51:06 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1403 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:51:06.890442 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-3290bff5-dadd-461f-a793-99d1320d010b tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807093ae546a4e42a21c2755f49abc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cca830d4d9384e99b6f499a457776de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:06.902070 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-3290bff5-dadd-461f-a793-99d1320d010b tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] 10.222.0.73 "GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c" status: 200 len: 1315 microversion: 2.1 time: 0.220317 Sep 16 09:51:06.904163 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 36/71] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:06 2022] GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:06.979653 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-df23c8ea-ef78-4918-b720-760f61d97382 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:06.980786 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-df23c8ea-ef78-4918-b720-760f61d97382 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: efec4ecb-65e7-4ca8-a29f-b87bc9ee1915] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:06.996937 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-df23c8ea-ef78-4918-b720-760f61d97382 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:06.997685 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-df23c8ea-ef78-4918-b720-760f61d97382 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:06.998164 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-df23c8ea-ef78-4918-b720-760f61d97382 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:06.998918 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-df23c8ea-ef78-4918-b720-760f61d97382 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:07.004222 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-df23c8ea-ef78-4918-b720-760f61d97382 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:07.004222 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-df23c8ea-ef78-4918-b720-760f61d97382 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:07.180406 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-df23c8ea-ef78-4918-b720-760f61d97382 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:07.189096 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-df23c8ea-ef78-4918-b720-760f61d97382 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915" status: 200 len: 1366 microversion: 2.1 time: 0.213838 Sep 16 09:51:07.189704 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 36/72] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:06 2022] GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:07.467199 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-d631a242-6e9e-4f79-a441-58d6e533c187 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:07.467870 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-d631a242-6e9e-4f79-a441-58d6e533c187 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:07.475219 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d631a242-6e9e-4f79-a441-58d6e533c187 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:07.475724 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d631a242-6e9e-4f79-a441-58d6e533c187 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:07.476166 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d631a242-6e9e-4f79-a441-58d6e533c187 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:07.476881 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d631a242-6e9e-4f79-a441-58d6e533c187 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:07.477511 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d631a242-6e9e-4f79-a441-58d6e533c187 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:07.477968 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d631a242-6e9e-4f79-a441-58d6e533c187 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:07.677534 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-d631a242-6e9e-4f79-a441-58d6e533c187 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:07.686148 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-d631a242-6e9e-4f79-a441-58d6e533c187 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1322 microversion: 2.1 time: 0.231126 Sep 16 09:51:07.689181 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 37/73] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:07 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:07.903340 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-57f790f6-ee16-4918-b582-a169baf3300f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:07.904088 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-57f790f6-ee16-4918-b582-a169baf3300f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:07.910285 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-57f790f6-ee16-4918-b582-a169baf3300f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:07.910773 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-57f790f6-ee16-4918-b582-a169baf3300f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:07.911255 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-57f790f6-ee16-4918-b582-a169baf3300f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:07.912088 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-57f790f6-ee16-4918-b582-a169baf3300f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:07.912549 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-57f790f6-ee16-4918-b582-a169baf3300f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:07.912978 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-57f790f6-ee16-4918-b582-a169baf3300f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:07.932487 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-392d66c2-51bd-45f6-a1fb-9ca4cb59e85f tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:07.933377 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-392d66c2-51bd-45f6-a1fb-9ca4cb59e85f tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] [instance: 480def5d-9bba-44e0-a53c-65239a428e1c] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:07.939659 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-392d66c2-51bd-45f6-a1fb-9ca4cb59e85f tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:07.940204 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-392d66c2-51bd-45f6-a1fb-9ca4cb59e85f tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:07.940643 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-392d66c2-51bd-45f6-a1fb-9ca4cb59e85f tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:07.941351 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-392d66c2-51bd-45f6-a1fb-9ca4cb59e85f tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:07.941849 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-392d66c2-51bd-45f6-a1fb-9ca4cb59e85f tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:07.942893 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-392d66c2-51bd-45f6-a1fb-9ca4cb59e85f tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:08.061205 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-57f790f6-ee16-4918-b582-a169baf3300f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:08.075085 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-57f790f6-ee16-4918-b582-a169baf3300f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:08.078755 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-57f790f6-ee16-4918-b582-a169baf3300f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:08.080740 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-57f790f6-ee16-4918-b582-a169baf3300f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1403 microversion: 2.20 time: 0.181558 Sep 16 09:51:08.093599 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 37/74] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:51:07 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1403 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:51:08.179941 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-392d66c2-51bd-45f6-a1fb-9ca4cb59e85f tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807093ae546a4e42a21c2755f49abc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cca830d4d9384e99b6f499a457776de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:08.192312 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-392d66c2-51bd-45f6-a1fb-9ca4cb59e85f tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] 10.222.0.73 "GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c" status: 200 len: 1315 microversion: 2.1 time: 0.263668 Sep 16 09:51:08.193220 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 38/75] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:07 2022] GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:51:08.214536 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-faa9c0d3-04ae-44e3-9298-02ba6abc1c5d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:08.215299 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-faa9c0d3-04ae-44e3-9298-02ba6abc1c5d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: efec4ecb-65e7-4ca8-a29f-b87bc9ee1915] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:08.236880 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-faa9c0d3-04ae-44e3-9298-02ba6abc1c5d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:08.237598 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-faa9c0d3-04ae-44e3-9298-02ba6abc1c5d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:08.238180 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-faa9c0d3-04ae-44e3-9298-02ba6abc1c5d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:08.239612 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-faa9c0d3-04ae-44e3-9298-02ba6abc1c5d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:08.243989 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-faa9c0d3-04ae-44e3-9298-02ba6abc1c5d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:08.245454 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-faa9c0d3-04ae-44e3-9298-02ba6abc1c5d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:08.424477 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-faa9c0d3-04ae-44e3-9298-02ba6abc1c5d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:08.433762 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-faa9c0d3-04ae-44e3-9298-02ba6abc1c5d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915" status: 200 len: 1366 microversion: 2.1 time: 0.224491 Sep 16 09:51:08.434744 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 38/76] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:08 2022] GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:08.709152 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-b83b1650-ecea-46cd-82cc-4c2c20a8aa45 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:08.710367 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-b83b1650-ecea-46cd-82cc-4c2c20a8aa45 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:08.716514 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b83b1650-ecea-46cd-82cc-4c2c20a8aa45 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:08.716999 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b83b1650-ecea-46cd-82cc-4c2c20a8aa45 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:08.717427 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b83b1650-ecea-46cd-82cc-4c2c20a8aa45 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:08.718148 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b83b1650-ecea-46cd-82cc-4c2c20a8aa45 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:08.719036 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b83b1650-ecea-46cd-82cc-4c2c20a8aa45 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:08.719885 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b83b1650-ecea-46cd-82cc-4c2c20a8aa45 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:08.927262 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-b83b1650-ecea-46cd-82cc-4c2c20a8aa45 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:08.927262 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-b83b1650-ecea-46cd-82cc-4c2c20a8aa45 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1322 microversion: 2.1 time: 0.220243 Sep 16 09:51:08.927262 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 39/77] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:08 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:09.112481 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-809d68d6-3802-45ff-8c56-613ca23a3e1c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:09.114886 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-809d68d6-3802-45ff-8c56-613ca23a3e1c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:09.120407 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-809d68d6-3802-45ff-8c56-613ca23a3e1c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:09.120900 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-809d68d6-3802-45ff-8c56-613ca23a3e1c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:09.121335 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-809d68d6-3802-45ff-8c56-613ca23a3e1c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:09.122081 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-809d68d6-3802-45ff-8c56-613ca23a3e1c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:09.122533 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-809d68d6-3802-45ff-8c56-613ca23a3e1c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:09.122962 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-809d68d6-3802-45ff-8c56-613ca23a3e1c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:09.218318 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-eb8d730e-3be1-4223-939e-cdf2aa11af2f tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:09.219708 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-eb8d730e-3be1-4223-939e-cdf2aa11af2f tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] [instance: 480def5d-9bba-44e0-a53c-65239a428e1c] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:09.230992 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-eb8d730e-3be1-4223-939e-cdf2aa11af2f tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:09.231507 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-eb8d730e-3be1-4223-939e-cdf2aa11af2f tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:09.231946 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-eb8d730e-3be1-4223-939e-cdf2aa11af2f tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:09.232646 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-eb8d730e-3be1-4223-939e-cdf2aa11af2f tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:09.237438 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-eb8d730e-3be1-4223-939e-cdf2aa11af2f tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:09.242725 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-eb8d730e-3be1-4223-939e-cdf2aa11af2f tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:09.515942 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-809d68d6-3802-45ff-8c56-613ca23a3e1c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:09.527368 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-809d68d6-3802-45ff-8c56-613ca23a3e1c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:09.529373 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-809d68d6-3802-45ff-8c56-613ca23a3e1c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:09.530889 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-809d68d6-3802-45ff-8c56-613ca23a3e1c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1403 microversion: 2.20 time: 0.422215 Sep 16 09:51:09.531832 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 39/78] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:51:09 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1403 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:51:09.539998 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-8f070705-bc68-40e5-b0f5-8df867754c63 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:09.541269 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-8f070705-bc68-40e5-b0f5-8df867754c63 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: efec4ecb-65e7-4ca8-a29f-b87bc9ee1915] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:09.549509 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8f070705-bc68-40e5-b0f5-8df867754c63 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:09.554790 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8f070705-bc68-40e5-b0f5-8df867754c63 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:09.557133 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8f070705-bc68-40e5-b0f5-8df867754c63 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:09.558384 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8f070705-bc68-40e5-b0f5-8df867754c63 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:09.559070 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8f070705-bc68-40e5-b0f5-8df867754c63 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:09.559722 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8f070705-bc68-40e5-b0f5-8df867754c63 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:09.610593 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-eb8d730e-3be1-4223-939e-cdf2aa11af2f tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807093ae546a4e42a21c2755f49abc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cca830d4d9384e99b6f499a457776de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:09.625224 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-eb8d730e-3be1-4223-939e-cdf2aa11af2f tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] 10.222.0.73 "GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c" status: 200 len: 1315 microversion: 2.1 time: 0.409628 Sep 16 09:51:09.626930 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 40/79] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:09 2022] GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c => generated 1315 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:51:09.977207 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-67450821-d10e-4bc0-9b63-14b84c12402a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:09.978499 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-67450821-d10e-4bc0-9b63-14b84c12402a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:09.994044 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-67450821-d10e-4bc0-9b63-14b84c12402a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:09.994538 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-67450821-d10e-4bc0-9b63-14b84c12402a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:09.994973 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-67450821-d10e-4bc0-9b63-14b84c12402a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:09.995767 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-67450821-d10e-4bc0-9b63-14b84c12402a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:09.996251 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-67450821-d10e-4bc0-9b63-14b84c12402a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:09.996857 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-67450821-d10e-4bc0-9b63-14b84c12402a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:10.467916 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-67450821-d10e-4bc0-9b63-14b84c12402a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:10.483816 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-67450821-d10e-4bc0-9b63-14b84c12402a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1322 microversion: 2.1 time: 0.507134 Sep 16 09:51:10.484836 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-8f070705-bc68-40e5-b0f5-8df867754c63 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:10.498565 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-8f070705-bc68-40e5-b0f5-8df867754c63 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915" status: 200 len: 1366 microversion: 2.1 time: 0.965203 Sep 16 09:51:10.500828 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 41/80] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:09 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1322 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:51:10.512372 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 40/81] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:09 2022] GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 => generated 1366 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:10.562774 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-c2c6cf13-15cf-4bcc-9538-b593cf6a2d07 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:10.563564 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-c2c6cf13-15cf-4bcc-9538-b593cf6a2d07 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:10.574779 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c2c6cf13-15cf-4bcc-9538-b593cf6a2d07 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:10.575703 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c2c6cf13-15cf-4bcc-9538-b593cf6a2d07 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:10.576170 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c2c6cf13-15cf-4bcc-9538-b593cf6a2d07 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:10.577101 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c2c6cf13-15cf-4bcc-9538-b593cf6a2d07 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:10.578157 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c2c6cf13-15cf-4bcc-9538-b593cf6a2d07 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:10.579960 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c2c6cf13-15cf-4bcc-9538-b593cf6a2d07 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:10.656526 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-130a82ec-a25b-4eb8-b1e9-d5c704e42d89 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:10.658271 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-130a82ec-a25b-4eb8-b1e9-d5c704e42d89 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] [instance: 480def5d-9bba-44e0-a53c-65239a428e1c] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:10.671703 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-130a82ec-a25b-4eb8-b1e9-d5c704e42d89 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:10.672665 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-130a82ec-a25b-4eb8-b1e9-d5c704e42d89 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:10.673117 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-130a82ec-a25b-4eb8-b1e9-d5c704e42d89 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:10.673889 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-130a82ec-a25b-4eb8-b1e9-d5c704e42d89 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:10.674352 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-130a82ec-a25b-4eb8-b1e9-d5c704e42d89 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:10.675201 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-130a82ec-a25b-4eb8-b1e9-d5c704e42d89 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:10.975433 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-c2c6cf13-15cf-4bcc-9538-b593cf6a2d07 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:10.990546 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-c2c6cf13-15cf-4bcc-9538-b593cf6a2d07 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:10.995132 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-c2c6cf13-15cf-4bcc-9538-b593cf6a2d07 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:10.995132 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-c2c6cf13-15cf-4bcc-9538-b593cf6a2d07 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1403 microversion: 2.20 time: 0.436738 Sep 16 09:51:10.996653 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 42/82] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:51:10 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1403 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:51:11.307103 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [req-70707fc9-0d71-42e4-87e9-9ede41096ca7 req-afff266d-9f98-4ea9-a48f-9ea79923b58d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efec4ecb-65e7-4ca8-a29f-b87bc9ee1915", "tag": "70b30d2d-a478-423b-bb6f-8944c8ac74de"}]} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:51:11.329173 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-70707fc9-0d71-42e4-87e9-9ede41096ca7 req-afff266d-9f98-4ea9-a48f-9ea79923b58d service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:11.330934 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-70707fc9-0d71-42e4-87e9-9ede41096ca7 req-afff266d-9f98-4ea9-a48f-9ea79923b58d service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:11.331481 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-70707fc9-0d71-42e4-87e9-9ede41096ca7 req-afff266d-9f98-4ea9-a48f-9ea79923b58d service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:11.358503 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.compute.server_external_events [req-70707fc9-0d71-42e4-87e9-9ede41096ca7 req-afff266d-9f98-4ea9-a48f-9ea79923b58d service nova] Creating event network-changed:70b30d2d-a478-423b-bb6f-8944c8ac74de for instance efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 on hv-cinder-79053 Sep 16 09:51:11.369871 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [req-70707fc9-0d71-42e4-87e9-9ede41096ca7 req-afff266d-9f98-4ea9-a48f-9ea79923b58d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062685 Sep 16 09:51:11.375872 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 43/83] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:51:11.386024 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-130a82ec-a25b-4eb8-b1e9-d5c704e42d89 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807093ae546a4e42a21c2755f49abc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cca830d4d9384e99b6f499a457776de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:11.394053 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-130a82ec-a25b-4eb8-b1e9-d5c704e42d89 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] 10.222.0.73 "GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c" status: 200 len: 1315 microversion: 2.1 time: 0.746208 Sep 16 09:51:11.399287 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 41/84] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:10 2022] GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c => generated 1315 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:11.509836 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-9426f366-43d2-4624-aa89-27e799e9d54c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:11.510437 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-9426f366-43d2-4624-aa89-27e799e9d54c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:11.517264 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9426f366-43d2-4624-aa89-27e799e9d54c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:11.518849 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9426f366-43d2-4624-aa89-27e799e9d54c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:11.520867 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9426f366-43d2-4624-aa89-27e799e9d54c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:11.521933 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9426f366-43d2-4624-aa89-27e799e9d54c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:11.523088 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9426f366-43d2-4624-aa89-27e799e9d54c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:11.523569 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9426f366-43d2-4624-aa89-27e799e9d54c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:11.530034 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-0a171531-3511-4322-9c00-136632d4749b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:11.530828 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-0a171531-3511-4322-9c00-136632d4749b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: efec4ecb-65e7-4ca8-a29f-b87bc9ee1915] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:11.543915 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0a171531-3511-4322-9c00-136632d4749b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:11.548059 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0a171531-3511-4322-9c00-136632d4749b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:11.548679 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0a171531-3511-4322-9c00-136632d4749b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:11.549566 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0a171531-3511-4322-9c00-136632d4749b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:11.550031 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0a171531-3511-4322-9c00-136632d4749b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:11.550457 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0a171531-3511-4322-9c00-136632d4749b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:11.733599 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-0a171531-3511-4322-9c00-136632d4749b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:11.741654 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-0a171531-3511-4322-9c00-136632d4749b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915" status: 200 len: 1366 microversion: 2.1 time: 0.220437 Sep 16 09:51:11.742252 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 42/85] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:11 2022] GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:11.754021 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-9426f366-43d2-4624-aa89-27e799e9d54c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:11.763414 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-9426f366-43d2-4624-aa89-27e799e9d54c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1322 microversion: 2.1 time: 0.257824 Sep 16 09:51:11.763921 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 44/86] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:11 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1322 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:12.046683 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-9e7ceb6c-1032-42dd-bafc-d583410af515 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:12.049237 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-9e7ceb6c-1032-42dd-bafc-d583410af515 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:12.056067 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9e7ceb6c-1032-42dd-bafc-d583410af515 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:12.056558 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9e7ceb6c-1032-42dd-bafc-d583410af515 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:12.056994 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9e7ceb6c-1032-42dd-bafc-d583410af515 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:12.057726 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9e7ceb6c-1032-42dd-bafc-d583410af515 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:12.058199 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9e7ceb6c-1032-42dd-bafc-d583410af515 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:12.058665 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9e7ceb6c-1032-42dd-bafc-d583410af515 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:12.205591 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-9e7ceb6c-1032-42dd-bafc-d583410af515 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:12.215297 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-9e7ceb6c-1032-42dd-bafc-d583410af515 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:12.218916 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-9e7ceb6c-1032-42dd-bafc-d583410af515 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:12.218916 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-9e7ceb6c-1032-42dd-bafc-d583410af515 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1403 microversion: 2.20 time: 0.180177 Sep 16 09:51:12.218916 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 43/87] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:51:12 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1403 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:51:12.422022 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-3b489742-8189-4ce1-967a-b9497b5168e2 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:12.422710 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-3b489742-8189-4ce1-967a-b9497b5168e2 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] [instance: 480def5d-9bba-44e0-a53c-65239a428e1c] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:12.428908 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3b489742-8189-4ce1-967a-b9497b5168e2 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:12.429392 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3b489742-8189-4ce1-967a-b9497b5168e2 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:12.429900 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3b489742-8189-4ce1-967a-b9497b5168e2 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:12.430557 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3b489742-8189-4ce1-967a-b9497b5168e2 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:12.431004 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3b489742-8189-4ce1-967a-b9497b5168e2 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:12.431424 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3b489742-8189-4ce1-967a-b9497b5168e2 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:12.569096 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-3b489742-8189-4ce1-967a-b9497b5168e2 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807093ae546a4e42a21c2755f49abc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cca830d4d9384e99b6f499a457776de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:12.576812 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-3b489742-8189-4ce1-967a-b9497b5168e2 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] 10.222.0.73 "GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c" status: 200 len: 1315 microversion: 2.1 time: 0.158728 Sep 16 09:51:12.577386 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 45/88] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:12 2022] GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:12.765510 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-7d264744-072b-42e5-91d5-983aee3b33f7 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:12.766193 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-7d264744-072b-42e5-91d5-983aee3b33f7 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: efec4ecb-65e7-4ca8-a29f-b87bc9ee1915] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:12.772380 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7d264744-072b-42e5-91d5-983aee3b33f7 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:12.772892 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7d264744-072b-42e5-91d5-983aee3b33f7 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:12.773317 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7d264744-072b-42e5-91d5-983aee3b33f7 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:12.774155 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7d264744-072b-42e5-91d5-983aee3b33f7 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:12.774739 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7d264744-072b-42e5-91d5-983aee3b33f7 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:12.775184 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7d264744-072b-42e5-91d5-983aee3b33f7 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:12.786508 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-97f554d4-e1d3-4111-8435-50a240f7c904 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:12.787182 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-97f554d4-e1d3-4111-8435-50a240f7c904 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:12.793500 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-97f554d4-e1d3-4111-8435-50a240f7c904 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:12.794026 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-97f554d4-e1d3-4111-8435-50a240f7c904 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:12.794773 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-97f554d4-e1d3-4111-8435-50a240f7c904 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:12.795708 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-97f554d4-e1d3-4111-8435-50a240f7c904 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:12.796282 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-97f554d4-e1d3-4111-8435-50a240f7c904 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:12.797003 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-97f554d4-e1d3-4111-8435-50a240f7c904 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:12.961139 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-7d264744-072b-42e5-91d5-983aee3b33f7 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:12.969978 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-7d264744-072b-42e5-91d5-983aee3b33f7 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915" status: 200 len: 1366 microversion: 2.1 time: 0.208371 Sep 16 09:51:12.972467 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 44/89] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:12 2022] GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:12.978131 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-97f554d4-e1d3-4111-8435-50a240f7c904 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:12.996787 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-97f554d4-e1d3-4111-8435-50a240f7c904 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1322 microversion: 2.1 time: 0.214797 Sep 16 09:51:12.997496 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 46/90] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:12 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:13.244697 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-e6b35f9e-ba97-4aa5-a01b-04028119c2a2 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:13.245328 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-e6b35f9e-ba97-4aa5-a01b-04028119c2a2 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:13.251237 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e6b35f9e-ba97-4aa5-a01b-04028119c2a2 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:13.251724 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e6b35f9e-ba97-4aa5-a01b-04028119c2a2 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:13.252157 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e6b35f9e-ba97-4aa5-a01b-04028119c2a2 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:13.252853 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e6b35f9e-ba97-4aa5-a01b-04028119c2a2 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:13.253304 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e6b35f9e-ba97-4aa5-a01b-04028119c2a2 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:13.253756 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e6b35f9e-ba97-4aa5-a01b-04028119c2a2 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:13.394698 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-e6b35f9e-ba97-4aa5-a01b-04028119c2a2 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:13.414935 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-e6b35f9e-ba97-4aa5-a01b-04028119c2a2 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:13.416571 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-e6b35f9e-ba97-4aa5-a01b-04028119c2a2 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:13.417920 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-e6b35f9e-ba97-4aa5-a01b-04028119c2a2 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1403 microversion: 2.20 time: 0.177529 Sep 16 09:51:13.418888 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 45/91] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:51:13 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1403 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:51:13.601974 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-5b5b9e49-0e24-477a-a9ce-f4dc8cf19f99 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:13.602815 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-5b5b9e49-0e24-477a-a9ce-f4dc8cf19f99 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] [instance: 480def5d-9bba-44e0-a53c-65239a428e1c] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:13.608935 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5b5b9e49-0e24-477a-a9ce-f4dc8cf19f99 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:13.609365 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5b5b9e49-0e24-477a-a9ce-f4dc8cf19f99 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:13.609842 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5b5b9e49-0e24-477a-a9ce-f4dc8cf19f99 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:13.610538 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5b5b9e49-0e24-477a-a9ce-f4dc8cf19f99 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:13.610997 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5b5b9e49-0e24-477a-a9ce-f4dc8cf19f99 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:13.611476 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5b5b9e49-0e24-477a-a9ce-f4dc8cf19f99 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:13.616121 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell1:SELECT=100 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:51:13.710597 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell0:SELECT=2 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:51:13.983470 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-5b5b9e49-0e24-477a-a9ce-f4dc8cf19f99 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807093ae546a4e42a21c2755f49abc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cca830d4d9384e99b6f499a457776de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:13.996593 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-5b5b9e49-0e24-477a-a9ce-f4dc8cf19f99 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] 10.222.0.73 "GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c" status: 200 len: 1315 microversion: 2.1 time: 0.399262 Sep 16 09:51:14.000256 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-5fa7ff4c-f4b9-4a70-b275-4635ff8ff67e tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:14.001576 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-5fa7ff4c-f4b9-4a70-b275-4635ff8ff67e tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: efec4ecb-65e7-4ca8-a29f-b87bc9ee1915] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:14.015184 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 47/92] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:13 2022] GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c => generated 1315 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:14.016556 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell0:SELECT=2 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:51:14.018957 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5fa7ff4c-f4b9-4a70-b275-4635ff8ff67e tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:14.019567 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5fa7ff4c-f4b9-4a70-b275-4635ff8ff67e tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:14.021511 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5fa7ff4c-f4b9-4a70-b275-4635ff8ff67e tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:14.022511 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5fa7ff4c-f4b9-4a70-b275-4635ff8ff67e tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:14.025714 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5fa7ff4c-f4b9-4a70-b275-4635ff8ff67e tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:14.026152 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5fa7ff4c-f4b9-4a70-b275-4635ff8ff67e tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:14.028971 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-3b5f106b-7fc7-4cc2-b9de-45495ec0cca0 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:14.034451 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-3b5f106b-7fc7-4cc2-b9de-45495ec0cca0 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:14.065684 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3b5f106b-7fc7-4cc2-b9de-45495ec0cca0 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:14.066371 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3b5f106b-7fc7-4cc2-b9de-45495ec0cca0 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:14.067379 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3b5f106b-7fc7-4cc2-b9de-45495ec0cca0 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:14.072053 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3b5f106b-7fc7-4cc2-b9de-45495ec0cca0 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:14.072556 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3b5f106b-7fc7-4cc2-b9de-45495ec0cca0 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:14.072999 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3b5f106b-7fc7-4cc2-b9de-45495ec0cca0 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:14.782206 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-3b5f106b-7fc7-4cc2-b9de-45495ec0cca0 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:14.804568 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-3b5f106b-7fc7-4cc2-b9de-45495ec0cca0 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1322 microversion: 2.1 time: 0.786913 Sep 16 09:51:14.805810 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 48/93] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:14 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1322 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:14.810532 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-eea2deee-b8f8-4f0b-b7c4-524ab285a83a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:14.811186 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-eea2deee-b8f8-4f0b-b7c4-524ab285a83a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:14.818229 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-eea2deee-b8f8-4f0b-b7c4-524ab285a83a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:14.819011 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-eea2deee-b8f8-4f0b-b7c4-524ab285a83a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:14.819648 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-eea2deee-b8f8-4f0b-b7c4-524ab285a83a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:14.820518 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-eea2deee-b8f8-4f0b-b7c4-524ab285a83a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:14.820972 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-eea2deee-b8f8-4f0b-b7c4-524ab285a83a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:14.821443 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-eea2deee-b8f8-4f0b-b7c4-524ab285a83a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:14.860908 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-5fa7ff4c-f4b9-4a70-b275-4635ff8ff67e tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:14.870761 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-5fa7ff4c-f4b9-4a70-b275-4635ff8ff67e tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915" status: 200 len: 1366 microversion: 2.1 time: 0.874321 Sep 16 09:51:14.872520 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 46/94] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:13 2022] GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 => generated 1366 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:51:15.025602 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-f5bcef4f-cbf0-4a83-a680-be50395c3ed5 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:15.026417 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-f5bcef4f-cbf0-4a83-a680-be50395c3ed5 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] [instance: 480def5d-9bba-44e0-a53c-65239a428e1c] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:15.034539 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f5bcef4f-cbf0-4a83-a680-be50395c3ed5 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:15.035826 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f5bcef4f-cbf0-4a83-a680-be50395c3ed5 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:15.036935 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f5bcef4f-cbf0-4a83-a680-be50395c3ed5 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:15.038655 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f5bcef4f-cbf0-4a83-a680-be50395c3ed5 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:15.039882 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f5bcef4f-cbf0-4a83-a680-be50395c3ed5 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:15.041000 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f5bcef4f-cbf0-4a83-a680-be50395c3ed5 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:15.216654 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-eea2deee-b8f8-4f0b-b7c4-524ab285a83a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:15.230545 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-eea2deee-b8f8-4f0b-b7c4-524ab285a83a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:15.234798 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-eea2deee-b8f8-4f0b-b7c4-524ab285a83a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:15.236757 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-eea2deee-b8f8-4f0b-b7c4-524ab285a83a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1403 microversion: 2.20 time: 0.429290 Sep 16 09:51:15.237931 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 49/95] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:51:14 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1403 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:51:15.375155 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f5bcef4f-cbf0-4a83-a680-be50395c3ed5 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807093ae546a4e42a21c2755f49abc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cca830d4d9384e99b6f499a457776de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:15.397512 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-f5bcef4f-cbf0-4a83-a680-be50395c3ed5 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] 10.222.0.73 "GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c" status: 200 len: 1315 microversion: 2.1 time: 0.364339 Sep 16 09:51:15.398207 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 47/96] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:15 2022] GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c => generated 1315 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:15.828055 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-571c7f49-1b98-4369-ae91-f536614458ae tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:15.829827 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-571c7f49-1b98-4369-ae91-f536614458ae tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:15.835461 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-571c7f49-1b98-4369-ae91-f536614458ae tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:15.835956 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-571c7f49-1b98-4369-ae91-f536614458ae tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:15.836415 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-571c7f49-1b98-4369-ae91-f536614458ae tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:15.837328 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-571c7f49-1b98-4369-ae91-f536614458ae tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:15.837807 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-571c7f49-1b98-4369-ae91-f536614458ae tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:15.838230 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-571c7f49-1b98-4369-ae91-f536614458ae tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:15.894928 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-7c904575-d44e-4a5c-be54-e5a0fbc5bf6f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:15.895664 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-7c904575-d44e-4a5c-be54-e5a0fbc5bf6f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: efec4ecb-65e7-4ca8-a29f-b87bc9ee1915] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:15.902064 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7c904575-d44e-4a5c-be54-e5a0fbc5bf6f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:15.902559 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7c904575-d44e-4a5c-be54-e5a0fbc5bf6f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:15.903003 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7c904575-d44e-4a5c-be54-e5a0fbc5bf6f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:15.903787 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7c904575-d44e-4a5c-be54-e5a0fbc5bf6f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:15.904248 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7c904575-d44e-4a5c-be54-e5a0fbc5bf6f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:15.904813 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7c904575-d44e-4a5c-be54-e5a0fbc5bf6f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:16.093012 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-571c7f49-1b98-4369-ae91-f536614458ae tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:16.095785 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-7c904575-d44e-4a5c-be54-e5a0fbc5bf6f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:16.102149 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-571c7f49-1b98-4369-ae91-f536614458ae tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1322 microversion: 2.1 time: 0.278301 Sep 16 09:51:16.102960 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 50/97] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:15 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1322 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:16.122215 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-7c904575-d44e-4a5c-be54-e5a0fbc5bf6f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915" status: 200 len: 1366 microversion: 2.1 time: 0.231203 Sep 16 09:51:16.124486 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 48/98] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:15 2022] GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:51:16.267365 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-d6a5ca36-678b-4569-b24f-2aafbe682639 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:16.268122 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-d6a5ca36-678b-4569-b24f-2aafbe682639 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:16.277434 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d6a5ca36-678b-4569-b24f-2aafbe682639 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:16.277963 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d6a5ca36-678b-4569-b24f-2aafbe682639 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:16.278464 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d6a5ca36-678b-4569-b24f-2aafbe682639 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:16.280741 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d6a5ca36-678b-4569-b24f-2aafbe682639 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:16.281945 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d6a5ca36-678b-4569-b24f-2aafbe682639 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:16.282563 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d6a5ca36-678b-4569-b24f-2aafbe682639 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:16.422906 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-3dd409a3-93bf-4a92-80c6-9bfddd5ea0a3 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:16.423538 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-3dd409a3-93bf-4a92-80c6-9bfddd5ea0a3 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] [instance: 480def5d-9bba-44e0-a53c-65239a428e1c] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:16.438574 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3dd409a3-93bf-4a92-80c6-9bfddd5ea0a3 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:16.438574 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3dd409a3-93bf-4a92-80c6-9bfddd5ea0a3 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:16.438574 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3dd409a3-93bf-4a92-80c6-9bfddd5ea0a3 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:16.438574 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3dd409a3-93bf-4a92-80c6-9bfddd5ea0a3 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:16.439002 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3dd409a3-93bf-4a92-80c6-9bfddd5ea0a3 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:16.439002 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3dd409a3-93bf-4a92-80c6-9bfddd5ea0a3 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:16.490749 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-d6a5ca36-678b-4569-b24f-2aafbe682639 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:16.500747 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-d6a5ca36-678b-4569-b24f-2aafbe682639 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:16.503681 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-d6a5ca36-678b-4569-b24f-2aafbe682639 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:16.508760 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-d6a5ca36-678b-4569-b24f-2aafbe682639 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1403 microversion: 2.20 time: 0.245529 Sep 16 09:51:16.510666 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 51/99] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:51:16 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1403 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:51:16.633317 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-3dd409a3-93bf-4a92-80c6-9bfddd5ea0a3 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807093ae546a4e42a21c2755f49abc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cca830d4d9384e99b6f499a457776de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:16.641846 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-3dd409a3-93bf-4a92-80c6-9bfddd5ea0a3 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] 10.222.0.73 "GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c" status: 200 len: 1315 microversion: 2.1 time: 0.223091 Sep 16 09:51:16.651742 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 49/100] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:16 2022] GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:17.127173 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-570c1462-59ea-4bf3-b5d2-748099e3b6d8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:17.128446 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-570c1462-59ea-4bf3-b5d2-748099e3b6d8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:17.135653 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-570c1462-59ea-4bf3-b5d2-748099e3b6d8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:17.136150 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-570c1462-59ea-4bf3-b5d2-748099e3b6d8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:17.136586 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-570c1462-59ea-4bf3-b5d2-748099e3b6d8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:17.137293 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-570c1462-59ea-4bf3-b5d2-748099e3b6d8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:17.137995 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-570c1462-59ea-4bf3-b5d2-748099e3b6d8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:17.138592 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-570c1462-59ea-4bf3-b5d2-748099e3b6d8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:17.164227 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-0ba4dbb6-f05c-49b0-9868-08f4ee702f30 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:17.165649 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-0ba4dbb6-f05c-49b0-9868-08f4ee702f30 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: efec4ecb-65e7-4ca8-a29f-b87bc9ee1915] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:17.176797 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0ba4dbb6-f05c-49b0-9868-08f4ee702f30 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:17.178113 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0ba4dbb6-f05c-49b0-9868-08f4ee702f30 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:17.178790 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0ba4dbb6-f05c-49b0-9868-08f4ee702f30 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:17.179743 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0ba4dbb6-f05c-49b0-9868-08f4ee702f30 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:17.180407 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0ba4dbb6-f05c-49b0-9868-08f4ee702f30 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:17.181048 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0ba4dbb6-f05c-49b0-9868-08f4ee702f30 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:17.321244 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-570c1462-59ea-4bf3-b5d2-748099e3b6d8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:17.330746 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-570c1462-59ea-4bf3-b5d2-748099e3b6d8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1322 microversion: 2.1 time: 0.207490 Sep 16 09:51:17.331332 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 52/101] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:17 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:17.355083 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-0ba4dbb6-f05c-49b0-9868-08f4ee702f30 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:17.362990 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-0ba4dbb6-f05c-49b0-9868-08f4ee702f30 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915" status: 200 len: 1366 microversion: 2.1 time: 0.203453 Sep 16 09:51:17.363844 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 50/102] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:17 2022] GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:17.536670 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-feb6fe53-f3cf-4442-81a7-affc5e928254 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:17.537274 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-feb6fe53-f3cf-4442-81a7-affc5e928254 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:17.544338 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-feb6fe53-f3cf-4442-81a7-affc5e928254 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:17.544816 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-feb6fe53-f3cf-4442-81a7-affc5e928254 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:17.545255 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-feb6fe53-f3cf-4442-81a7-affc5e928254 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:17.545975 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-feb6fe53-f3cf-4442-81a7-affc5e928254 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:17.546472 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-feb6fe53-f3cf-4442-81a7-affc5e928254 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:17.546894 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-feb6fe53-f3cf-4442-81a7-affc5e928254 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:17.669343 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-7ac07115-735a-4f64-8fea-2623c5cceb42 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:17.670015 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-7ac07115-735a-4f64-8fea-2623c5cceb42 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] [instance: 480def5d-9bba-44e0-a53c-65239a428e1c] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:17.678026 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7ac07115-735a-4f64-8fea-2623c5cceb42 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:17.678888 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7ac07115-735a-4f64-8fea-2623c5cceb42 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:17.679629 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7ac07115-735a-4f64-8fea-2623c5cceb42 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:17.680730 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7ac07115-735a-4f64-8fea-2623c5cceb42 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:17.681302 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7ac07115-735a-4f64-8fea-2623c5cceb42 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:17.681828 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7ac07115-735a-4f64-8fea-2623c5cceb42 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:17.684691 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-feb6fe53-f3cf-4442-81a7-affc5e928254 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:17.702530 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-feb6fe53-f3cf-4442-81a7-affc5e928254 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:17.704433 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-feb6fe53-f3cf-4442-81a7-affc5e928254 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:17.705915 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-feb6fe53-f3cf-4442-81a7-affc5e928254 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1403 microversion: 2.20 time: 0.173804 Sep 16 09:51:17.708233 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 53/103] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:51:17 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1403 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:51:17.866588 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-7ac07115-735a-4f64-8fea-2623c5cceb42 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807093ae546a4e42a21c2755f49abc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cca830d4d9384e99b6f499a457776de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:17.876952 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-7ac07115-735a-4f64-8fea-2623c5cceb42 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] 10.222.0.73 "GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c" status: 200 len: 1315 microversion: 2.1 time: 0.216209 Sep 16 09:51:17.878699 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 51/104] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:17 2022] GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:18.355571 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-e3e7e001-dbc5-4672-ba4c-50811a86eadb tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:18.356180 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-e3e7e001-dbc5-4672-ba4c-50811a86eadb tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:18.362148 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e3e7e001-dbc5-4672-ba4c-50811a86eadb tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:18.362622 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e3e7e001-dbc5-4672-ba4c-50811a86eadb tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:18.363057 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e3e7e001-dbc5-4672-ba4c-50811a86eadb tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:18.364426 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e3e7e001-dbc5-4672-ba4c-50811a86eadb tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:18.364881 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e3e7e001-dbc5-4672-ba4c-50811a86eadb tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:18.365300 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e3e7e001-dbc5-4672-ba4c-50811a86eadb tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:18.388656 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-e50135ed-d86c-471c-bc2f-68c5de4220b5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:18.388656 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-e50135ed-d86c-471c-bc2f-68c5de4220b5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: efec4ecb-65e7-4ca8-a29f-b87bc9ee1915] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:18.395975 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e50135ed-d86c-471c-bc2f-68c5de4220b5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:18.396725 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e50135ed-d86c-471c-bc2f-68c5de4220b5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:18.397174 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e50135ed-d86c-471c-bc2f-68c5de4220b5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:18.397940 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e50135ed-d86c-471c-bc2f-68c5de4220b5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:18.398563 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e50135ed-d86c-471c-bc2f-68c5de4220b5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:18.399032 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e50135ed-d86c-471c-bc2f-68c5de4220b5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:18.446070 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=100 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:51:18.529898 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-e3e7e001-dbc5-4672-ba4c-50811a86eadb tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:18.541025 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-e3e7e001-dbc5-4672-ba4c-50811a86eadb tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1322 microversion: 2.1 time: 0.189196 Sep 16 09:51:18.545636 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 54/105] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:18 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:18.673919 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-e50135ed-d86c-471c-bc2f-68c5de4220b5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:18.682914 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-e50135ed-d86c-471c-bc2f-68c5de4220b5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915" status: 200 len: 1366 microversion: 2.1 time: 0.299353 Sep 16 09:51:18.685594 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 52/106] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:18 2022] GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 => generated 1366 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:51:18.708066 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [req-360e3ba9-3297-4702-a862-f42d8ef14136 req-ce035ed9-a02b-4f4c-9d4c-79e6fa726b03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88a0813e-ace7-48df-b688-533c8dbc81de", "name": "network-vif-plugged", "status": "completed", "tag": "55883b34-2ac0-4ba3-b4af-c5503b0d8fc9"}]} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:51:18.715449 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-360e3ba9-3297-4702-a862-f42d8ef14136 req-ce035ed9-a02b-4f4c-9d4c-79e6fa726b03 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:18.715935 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-360e3ba9-3297-4702-a862-f42d8ef14136 req-ce035ed9-a02b-4f4c-9d4c-79e6fa726b03 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:18.716446 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-360e3ba9-3297-4702-a862-f42d8ef14136 req-ce035ed9-a02b-4f4c-9d4c-79e6fa726b03 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:18.732871 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.compute.server_external_events [req-360e3ba9-3297-4702-a862-f42d8ef14136 req-ce035ed9-a02b-4f4c-9d4c-79e6fa726b03 service nova] Creating event network-vif-plugged:55883b34-2ac0-4ba3-b4af-c5503b0d8fc9 for instance 88a0813e-ace7-48df-b688-533c8dbc81de on hv-cinder-79053 Sep 16 09:51:18.735779 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-0cb1fb24-bb38-4cc2-9a30-ffad1a87f486 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:18.736655 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-0cb1fb24-bb38-4cc2-9a30-ffad1a87f486 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:18.739686 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [req-360e3ba9-3297-4702-a862-f42d8ef14136 req-ce035ed9-a02b-4f4c-9d4c-79e6fa726b03 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121332 Sep 16 09:51:18.739686 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 55/107] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 09:51:18.777599 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0cb1fb24-bb38-4cc2-9a30-ffad1a87f486 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:18.778092 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0cb1fb24-bb38-4cc2-9a30-ffad1a87f486 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:18.778527 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0cb1fb24-bb38-4cc2-9a30-ffad1a87f486 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:18.779233 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0cb1fb24-bb38-4cc2-9a30-ffad1a87f486 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:18.779683 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0cb1fb24-bb38-4cc2-9a30-ffad1a87f486 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:18.780107 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0cb1fb24-bb38-4cc2-9a30-ffad1a87f486 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:18.905851 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-41706ec8-6288-4c0c-9879-5e39eecd2c23 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:18.907008 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-41706ec8-6288-4c0c-9879-5e39eecd2c23 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] [instance: 480def5d-9bba-44e0-a53c-65239a428e1c] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:18.938422 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-41706ec8-6288-4c0c-9879-5e39eecd2c23 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:18.939606 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-41706ec8-6288-4c0c-9879-5e39eecd2c23 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:18.940448 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-41706ec8-6288-4c0c-9879-5e39eecd2c23 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:18.941527 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-41706ec8-6288-4c0c-9879-5e39eecd2c23 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:18.942143 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-41706ec8-6288-4c0c-9879-5e39eecd2c23 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:18.942815 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-41706ec8-6288-4c0c-9879-5e39eecd2c23 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:19.198181 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-0cb1fb24-bb38-4cc2-9a30-ffad1a87f486 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:19.207686 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-0cb1fb24-bb38-4cc2-9a30-ffad1a87f486 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:19.209661 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-0cb1fb24-bb38-4cc2-9a30-ffad1a87f486 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:19.210981 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-0cb1fb24-bb38-4cc2-9a30-ffad1a87f486 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1403 microversion: 2.20 time: 0.482153 Sep 16 09:51:19.211716 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 53/108] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:51:18 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1403 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 09:51:19.352332 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-41706ec8-6288-4c0c-9879-5e39eecd2c23 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807093ae546a4e42a21c2755f49abc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cca830d4d9384e99b6f499a457776de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:19.368311 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-41706ec8-6288-4c0c-9879-5e39eecd2c23 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] 10.222.0.73 "GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c" status: 200 len: 1315 microversion: 2.1 time: 0.467934 Sep 16 09:51:19.374991 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 56/109] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:18 2022] GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c => generated 1315 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:19.566290 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d7d149d1-74e5-4303-94d0-5f0c18b2d582 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:19.570932 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-d7d149d1-74e5-4303-94d0-5f0c18b2d582 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:19.574430 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d7d149d1-74e5-4303-94d0-5f0c18b2d582 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:19.575281 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d7d149d1-74e5-4303-94d0-5f0c18b2d582 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:19.576000 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d7d149d1-74e5-4303-94d0-5f0c18b2d582 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:19.577417 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d7d149d1-74e5-4303-94d0-5f0c18b2d582 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:19.577417 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d7d149d1-74e5-4303-94d0-5f0c18b2d582 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:19.577786 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d7d149d1-74e5-4303-94d0-5f0c18b2d582 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:19.706502 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-66fe5354-7196-49d8-aa28-958c721e5976 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:19.708041 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-66fe5354-7196-49d8-aa28-958c721e5976 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: efec4ecb-65e7-4ca8-a29f-b87bc9ee1915] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:19.714558 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-66fe5354-7196-49d8-aa28-958c721e5976 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:19.715238 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-66fe5354-7196-49d8-aa28-958c721e5976 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:19.715782 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-66fe5354-7196-49d8-aa28-958c721e5976 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:19.716586 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-66fe5354-7196-49d8-aa28-958c721e5976 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:19.717148 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-66fe5354-7196-49d8-aa28-958c721e5976 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:19.717723 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-66fe5354-7196-49d8-aa28-958c721e5976 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:19.729219 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-d7d149d1-74e5-4303-94d0-5f0c18b2d582 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:19.739052 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-d7d149d1-74e5-4303-94d0-5f0c18b2d582 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1322 microversion: 2.1 time: 0.177907 Sep 16 09:51:19.739873 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 54/110] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:19 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:19.851009 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-66fe5354-7196-49d8-aa28-958c721e5976 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:19.860362 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-66fe5354-7196-49d8-aa28-958c721e5976 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915" status: 200 len: 1366 microversion: 2.1 time: 0.157865 Sep 16 09:51:19.873991 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 57/111] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:19 2022] GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:51:20.237312 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-0dc8460e-c551-403c-9c73-be3c15f42a7d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:20.238870 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-0dc8460e-c551-403c-9c73-be3c15f42a7d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:20.246472 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0dc8460e-c551-403c-9c73-be3c15f42a7d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:20.246962 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0dc8460e-c551-403c-9c73-be3c15f42a7d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:20.247396 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0dc8460e-c551-403c-9c73-be3c15f42a7d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:20.248122 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0dc8460e-c551-403c-9c73-be3c15f42a7d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:20.248577 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0dc8460e-c551-403c-9c73-be3c15f42a7d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:20.248997 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0dc8460e-c551-403c-9c73-be3c15f42a7d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:20.393967 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-6e6928b4-4452-4e22-8ba0-a3e1811bd5cf tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:20.395775 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-6e6928b4-4452-4e22-8ba0-a3e1811bd5cf tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] [instance: 480def5d-9bba-44e0-a53c-65239a428e1c] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:20.404119 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-0dc8460e-c551-403c-9c73-be3c15f42a7d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:20.404286 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6e6928b4-4452-4e22-8ba0-a3e1811bd5cf tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:20.404695 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6e6928b4-4452-4e22-8ba0-a3e1811bd5cf tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:20.405138 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6e6928b4-4452-4e22-8ba0-a3e1811bd5cf tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:20.405912 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6e6928b4-4452-4e22-8ba0-a3e1811bd5cf tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:20.406522 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6e6928b4-4452-4e22-8ba0-a3e1811bd5cf tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:20.407090 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6e6928b4-4452-4e22-8ba0-a3e1811bd5cf tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:20.418007 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-0dc8460e-c551-403c-9c73-be3c15f42a7d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:20.419434 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-0dc8460e-c551-403c-9c73-be3c15f42a7d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:20.422401 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-0dc8460e-c551-403c-9c73-be3c15f42a7d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1403 microversion: 2.20 time: 0.189108 Sep 16 09:51:20.424180 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 55/112] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:51:20 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1403 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:51:20.592914 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-6e6928b4-4452-4e22-8ba0-a3e1811bd5cf tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807093ae546a4e42a21c2755f49abc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cca830d4d9384e99b6f499a457776de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:20.605103 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-6e6928b4-4452-4e22-8ba0-a3e1811bd5cf tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] 10.222.0.73 "GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c" status: 200 len: 1315 microversion: 2.1 time: 0.216115 Sep 16 09:51:20.606952 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 58/113] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:20 2022] GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:51:20.763610 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-4568446e-9d52-4e47-b01b-dfc38e8b6519 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:20.764322 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-4568446e-9d52-4e47-b01b-dfc38e8b6519 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:20.777769 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4568446e-9d52-4e47-b01b-dfc38e8b6519 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:20.778407 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4568446e-9d52-4e47-b01b-dfc38e8b6519 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:20.778974 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4568446e-9d52-4e47-b01b-dfc38e8b6519 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:20.779902 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4568446e-9d52-4e47-b01b-dfc38e8b6519 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:20.780429 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4568446e-9d52-4e47-b01b-dfc38e8b6519 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:20.780881 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4568446e-9d52-4e47-b01b-dfc38e8b6519 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:20.868855 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [req-91bf7459-76cc-4e5c-865e-bbd7027a142b req-90afba37-cd49-41eb-a1d9-c8ca5229c5dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f634aa6d-e24c-48df-946f-3166fd76273a", "name": "network-vif-plugged", "status": "completed", "tag": "2959b5a1-1a1a-4ce9-93ab-cb413d960925"}, {"server_uuid": "480def5d-9bba-44e0-a53c-65239a428e1c", "name": "network-vif-plugged", "status": "completed", "tag": "c050f3bc-122c-4343-b68a-ba8664cb732b"}]} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:51:20.881751 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-91bf7459-76cc-4e5c-865e-bbd7027a142b req-90afba37-cd49-41eb-a1d9-c8ca5229c5dc service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:20.882518 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-91bf7459-76cc-4e5c-865e-bbd7027a142b req-90afba37-cd49-41eb-a1d9-c8ca5229c5dc service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:20.883131 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-91bf7459-76cc-4e5c-865e-bbd7027a142b req-90afba37-cd49-41eb-a1d9-c8ca5229c5dc service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:20.905964 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.compute.server_external_events [req-91bf7459-76cc-4e5c-865e-bbd7027a142b req-90afba37-cd49-41eb-a1d9-c8ca5229c5dc service nova] Creating event network-vif-plugged:2959b5a1-1a1a-4ce9-93ab-cb413d960925 for instance f634aa6d-e24c-48df-946f-3166fd76273a on hv-cinder-79053 Sep 16 09:51:20.906650 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.compute.server_external_events [req-91bf7459-76cc-4e5c-865e-bbd7027a142b req-90afba37-cd49-41eb-a1d9-c8ca5229c5dc service nova] Creating event network-vif-plugged:c050f3bc-122c-4343-b68a-ba8664cb732b for instance 480def5d-9bba-44e0-a53c-65239a428e1c on hv-cinder-79053 Sep 16 09:51:20.914764 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [req-91bf7459-76cc-4e5c-865e-bbd7027a142b req-90afba37-cd49-41eb-a1d9-c8ca5229c5dc service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.054095 Sep 16 09:51:20.915589 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 59/114] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 09:51:20.922360 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-5008d153-66c8-4d52-9d62-92e28fb8e271 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:20.923051 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-5008d153-66c8-4d52-9d62-92e28fb8e271 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: efec4ecb-65e7-4ca8-a29f-b87bc9ee1915] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:20.932819 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5008d153-66c8-4d52-9d62-92e28fb8e271 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:20.933134 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5008d153-66c8-4d52-9d62-92e28fb8e271 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:20.934046 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5008d153-66c8-4d52-9d62-92e28fb8e271 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:20.934753 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5008d153-66c8-4d52-9d62-92e28fb8e271 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:20.935259 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5008d153-66c8-4d52-9d62-92e28fb8e271 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:20.935688 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5008d153-66c8-4d52-9d62-92e28fb8e271 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:20.948302 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-4568446e-9d52-4e47-b01b-dfc38e8b6519 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:20.957525 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-4568446e-9d52-4e47-b01b-dfc38e8b6519 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1322 microversion: 2.1 time: 0.196873 Sep 16 09:51:20.958610 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 56/115] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:20 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:21.094805 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-5008d153-66c8-4d52-9d62-92e28fb8e271 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:21.104317 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-5008d153-66c8-4d52-9d62-92e28fb8e271 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915" status: 200 len: 1366 microversion: 2.1 time: 0.186551 Sep 16 09:51:21.104898 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 60/116] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:20 2022] GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:21.450677 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-10bbe630-b255-4414-8393-5e63994addd9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:21.451289 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-10bbe630-b255-4414-8393-5e63994addd9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:21.458282 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-10bbe630-b255-4414-8393-5e63994addd9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:21.458974 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-10bbe630-b255-4414-8393-5e63994addd9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:21.459405 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-10bbe630-b255-4414-8393-5e63994addd9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:21.460305 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-10bbe630-b255-4414-8393-5e63994addd9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:21.460763 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-10bbe630-b255-4414-8393-5e63994addd9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:21.461261 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-10bbe630-b255-4414-8393-5e63994addd9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:21.608890 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-10bbe630-b255-4414-8393-5e63994addd9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:21.617502 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-10bbe630-b255-4414-8393-5e63994addd9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:21.619050 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-10bbe630-b255-4414-8393-5e63994addd9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:21.620175 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-10bbe630-b255-4414-8393-5e63994addd9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1403 microversion: 2.20 time: 0.173968 Sep 16 09:51:21.620743 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 57/117] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:51:21 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1403 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:51:21.632493 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-3589b555-0546-4d09-864d-b7e7ac5f2d8b tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:21.633580 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-3589b555-0546-4d09-864d-b7e7ac5f2d8b tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] [instance: 480def5d-9bba-44e0-a53c-65239a428e1c] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:21.640395 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3589b555-0546-4d09-864d-b7e7ac5f2d8b tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:21.640938 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3589b555-0546-4d09-864d-b7e7ac5f2d8b tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:21.650388 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3589b555-0546-4d09-864d-b7e7ac5f2d8b tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:21.650388 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3589b555-0546-4d09-864d-b7e7ac5f2d8b tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:21.650388 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3589b555-0546-4d09-864d-b7e7ac5f2d8b tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:21.650388 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3589b555-0546-4d09-864d-b7e7ac5f2d8b tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:21.862348 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-3589b555-0546-4d09-864d-b7e7ac5f2d8b tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807093ae546a4e42a21c2755f49abc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cca830d4d9384e99b6f499a457776de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:21.870892 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-3589b555-0546-4d09-864d-b7e7ac5f2d8b tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] 10.222.0.73 "GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c" status: 200 len: 1315 microversion: 2.1 time: 0.242816 Sep 16 09:51:21.871467 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 61/118] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:21 2022] GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:21.981730 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-8e31f463-b50d-4c3f-b212-1d1c0a0d1695 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:21.982460 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-8e31f463-b50d-4c3f-b212-1d1c0a0d1695 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:21.989107 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8e31f463-b50d-4c3f-b212-1d1c0a0d1695 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:21.989874 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8e31f463-b50d-4c3f-b212-1d1c0a0d1695 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:21.990362 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8e31f463-b50d-4c3f-b212-1d1c0a0d1695 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:21.991109 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8e31f463-b50d-4c3f-b212-1d1c0a0d1695 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:21.991575 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8e31f463-b50d-4c3f-b212-1d1c0a0d1695 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:21.992007 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8e31f463-b50d-4c3f-b212-1d1c0a0d1695 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:22.127385 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-351367b8-7423-4e94-b934-ac3b4adfd71c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:22.128146 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-351367b8-7423-4e94-b934-ac3b4adfd71c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: efec4ecb-65e7-4ca8-a29f-b87bc9ee1915] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:22.132499 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-8e31f463-b50d-4c3f-b212-1d1c0a0d1695 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:22.137526 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-351367b8-7423-4e94-b934-ac3b4adfd71c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:22.138068 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-351367b8-7423-4e94-b934-ac3b4adfd71c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:22.138548 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-351367b8-7423-4e94-b934-ac3b4adfd71c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:22.139252 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-351367b8-7423-4e94-b934-ac3b4adfd71c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:22.139813 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-351367b8-7423-4e94-b934-ac3b4adfd71c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:22.140242 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-351367b8-7423-4e94-b934-ac3b4adfd71c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:22.140344 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-8e31f463-b50d-4c3f-b212-1d1c0a0d1695 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1322 microversion: 2.1 time: 0.162447 Sep 16 09:51:22.140878 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 58/119] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:21 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:51:22.270534 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-351367b8-7423-4e94-b934-ac3b4adfd71c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:22.278177 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-351367b8-7423-4e94-b934-ac3b4adfd71c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915" status: 200 len: 1366 microversion: 2.1 time: 0.154968 Sep 16 09:51:22.278749 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 62/120] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:22 2022] GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:22.650345 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-1b573916-f4fc-41f2-a52a-0bf637ba43db tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:22.651145 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-1b573916-f4fc-41f2-a52a-0bf637ba43db tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:22.657245 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1b573916-f4fc-41f2-a52a-0bf637ba43db tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:22.657855 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1b573916-f4fc-41f2-a52a-0bf637ba43db tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:22.658296 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1b573916-f4fc-41f2-a52a-0bf637ba43db tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:22.658998 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1b573916-f4fc-41f2-a52a-0bf637ba43db tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:22.659458 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1b573916-f4fc-41f2-a52a-0bf637ba43db tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:22.659904 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1b573916-f4fc-41f2-a52a-0bf637ba43db tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:22.825479 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-1b573916-f4fc-41f2-a52a-0bf637ba43db tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:22.834364 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-1b573916-f4fc-41f2-a52a-0bf637ba43db tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:22.835914 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-1b573916-f4fc-41f2-a52a-0bf637ba43db tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:22.837161 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-1b573916-f4fc-41f2-a52a-0bf637ba43db tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1403 microversion: 2.20 time: 0.190706 Sep 16 09:51:22.837924 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 59/121] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:51:22 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1403 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 09:51:22.895509 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-dd8fcaea-0994-4df1-ac96-72b40f35792d tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:22.896108 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-dd8fcaea-0994-4df1-ac96-72b40f35792d tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] [instance: 480def5d-9bba-44e0-a53c-65239a428e1c] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:22.902101 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-dd8fcaea-0994-4df1-ac96-72b40f35792d tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:22.902579 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-dd8fcaea-0994-4df1-ac96-72b40f35792d tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:22.903047 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-dd8fcaea-0994-4df1-ac96-72b40f35792d tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:22.903751 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-dd8fcaea-0994-4df1-ac96-72b40f35792d tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:22.904199 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-dd8fcaea-0994-4df1-ac96-72b40f35792d tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:22.904616 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-dd8fcaea-0994-4df1-ac96-72b40f35792d tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:23.048218 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-dd8fcaea-0994-4df1-ac96-72b40f35792d tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807093ae546a4e42a21c2755f49abc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cca830d4d9384e99b6f499a457776de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:23.056593 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-dd8fcaea-0994-4df1-ac96-72b40f35792d tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] 10.222.0.73 "GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c" status: 200 len: 1315 microversion: 2.1 time: 0.164955 Sep 16 09:51:23.057474 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 63/122] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:22 2022] GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:23.164991 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-f71c97ef-9e4f-43d9-bfe5-a0eb21a3a7e4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:23.166444 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-f71c97ef-9e4f-43d9-bfe5-a0eb21a3a7e4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:23.173359 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f71c97ef-9e4f-43d9-bfe5-a0eb21a3a7e4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:23.174112 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f71c97ef-9e4f-43d9-bfe5-a0eb21a3a7e4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:23.174748 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f71c97ef-9e4f-43d9-bfe5-a0eb21a3a7e4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:23.175469 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f71c97ef-9e4f-43d9-bfe5-a0eb21a3a7e4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:23.176502 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f71c97ef-9e4f-43d9-bfe5-a0eb21a3a7e4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:23.177248 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f71c97ef-9e4f-43d9-bfe5-a0eb21a3a7e4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:23.301681 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-f31fa3ee-290f-43fd-a9a0-7f2d64b33ea7 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:23.302307 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-f31fa3ee-290f-43fd-a9a0-7f2d64b33ea7 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: efec4ecb-65e7-4ca8-a29f-b87bc9ee1915] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:23.308864 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f31fa3ee-290f-43fd-a9a0-7f2d64b33ea7 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:23.309351 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f31fa3ee-290f-43fd-a9a0-7f2d64b33ea7 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:23.309836 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f31fa3ee-290f-43fd-a9a0-7f2d64b33ea7 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:23.310528 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f31fa3ee-290f-43fd-a9a0-7f2d64b33ea7 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:23.310984 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f31fa3ee-290f-43fd-a9a0-7f2d64b33ea7 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:23.311416 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f31fa3ee-290f-43fd-a9a0-7f2d64b33ea7 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:23.319864 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f71c97ef-9e4f-43d9-bfe5-a0eb21a3a7e4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:23.327513 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-f71c97ef-9e4f-43d9-bfe5-a0eb21a3a7e4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1322 microversion: 2.1 time: 0.167363 Sep 16 09:51:23.328096 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 60/123] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:23 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:51:23.448611 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-f31fa3ee-290f-43fd-a9a0-7f2d64b33ea7 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:23.459144 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-f31fa3ee-290f-43fd-a9a0-7f2d64b33ea7 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915" status: 200 len: 1366 microversion: 2.1 time: 0.161554 Sep 16 09:51:23.459720 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 64/124] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:23 2022] GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:51:23.862850 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-76f8ab06-5bfb-4756-b4c9-75fce07daceb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:23.863769 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-76f8ab06-5bfb-4756-b4c9-75fce07daceb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:23.870082 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-76f8ab06-5bfb-4756-b4c9-75fce07daceb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:23.870600 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-76f8ab06-5bfb-4756-b4c9-75fce07daceb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:23.871068 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-76f8ab06-5bfb-4756-b4c9-75fce07daceb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:23.871771 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-76f8ab06-5bfb-4756-b4c9-75fce07daceb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:23.875596 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-76f8ab06-5bfb-4756-b4c9-75fce07daceb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:23.875596 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-76f8ab06-5bfb-4756-b4c9-75fce07daceb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:24.005578 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-76f8ab06-5bfb-4756-b4c9-75fce07daceb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:24.013937 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-76f8ab06-5bfb-4756-b4c9-75fce07daceb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:24.015430 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-76f8ab06-5bfb-4756-b4c9-75fce07daceb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:24.016544 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-76f8ab06-5bfb-4756-b4c9-75fce07daceb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1403 microversion: 2.20 time: 0.157602 Sep 16 09:51:24.017102 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 61/125] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:51:23 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1403 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:51:24.079671 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-a23a13fd-0cda-4a58-9b91-f732e300353b tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:24.080284 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-a23a13fd-0cda-4a58-9b91-f732e300353b tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] [instance: 480def5d-9bba-44e0-a53c-65239a428e1c] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:24.086640 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a23a13fd-0cda-4a58-9b91-f732e300353b tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:24.087124 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a23a13fd-0cda-4a58-9b91-f732e300353b tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:24.087562 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a23a13fd-0cda-4a58-9b91-f732e300353b tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:24.088252 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a23a13fd-0cda-4a58-9b91-f732e300353b tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:24.088973 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a23a13fd-0cda-4a58-9b91-f732e300353b tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:24.089402 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a23a13fd-0cda-4a58-9b91-f732e300353b tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:24.096497 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell1:SELECT=100 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:51:24.222175 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-a23a13fd-0cda-4a58-9b91-f732e300353b tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807093ae546a4e42a21c2755f49abc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cca830d4d9384e99b6f499a457776de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:24.229994 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-a23a13fd-0cda-4a58-9b91-f732e300353b tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] 10.222.0.73 "GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c" status: 200 len: 1315 microversion: 2.1 time: 0.154101 Sep 16 09:51:24.230557 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 65/126] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:24 2022] GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:24.351426 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-445c6e51-d707-444d-8962-fbe1a4694277 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:24.352075 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-445c6e51-d707-444d-8962-fbe1a4694277 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:24.357902 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-445c6e51-d707-444d-8962-fbe1a4694277 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:24.358377 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-445c6e51-d707-444d-8962-fbe1a4694277 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:24.358807 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-445c6e51-d707-444d-8962-fbe1a4694277 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:24.359483 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-445c6e51-d707-444d-8962-fbe1a4694277 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:24.359939 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-445c6e51-d707-444d-8962-fbe1a4694277 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:24.360349 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-445c6e51-d707-444d-8962-fbe1a4694277 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:24.483852 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-13365914-f297-487a-86c6-224dbd21e002 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:24.484705 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-13365914-f297-487a-86c6-224dbd21e002 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: efec4ecb-65e7-4ca8-a29f-b87bc9ee1915] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:24.492236 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-13365914-f297-487a-86c6-224dbd21e002 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:24.492922 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-13365914-f297-487a-86c6-224dbd21e002 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:24.493632 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-13365914-f297-487a-86c6-224dbd21e002 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:24.494545 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-13365914-f297-487a-86c6-224dbd21e002 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:24.495022 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-13365914-f297-487a-86c6-224dbd21e002 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:24.495454 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-13365914-f297-487a-86c6-224dbd21e002 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:24.515760 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-445c6e51-d707-444d-8962-fbe1a4694277 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:24.528112 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-445c6e51-d707-444d-8962-fbe1a4694277 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1322 microversion: 2.1 time: 0.180979 Sep 16 09:51:24.529003 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 62/127] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:24 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:24.646776 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-13365914-f297-487a-86c6-224dbd21e002 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:24.654479 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-13365914-f297-487a-86c6-224dbd21e002 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915" status: 200 len: 1366 microversion: 2.1 time: 0.175042 Sep 16 09:51:24.655048 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 66/128] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:24 2022] GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:51:25.042517 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d200b53b-e7fb-452a-9a99-5cd32b61aa1f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:25.043032 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-d200b53b-e7fb-452a-9a99-5cd32b61aa1f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:25.048980 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d200b53b-e7fb-452a-9a99-5cd32b61aa1f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:25.049460 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d200b53b-e7fb-452a-9a99-5cd32b61aa1f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:25.049962 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d200b53b-e7fb-452a-9a99-5cd32b61aa1f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:25.050823 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d200b53b-e7fb-452a-9a99-5cd32b61aa1f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:25.051350 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d200b53b-e7fb-452a-9a99-5cd32b61aa1f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:25.051777 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d200b53b-e7fb-452a-9a99-5cd32b61aa1f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:25.178874 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-d200b53b-e7fb-452a-9a99-5cd32b61aa1f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:25.186871 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-d200b53b-e7fb-452a-9a99-5cd32b61aa1f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:25.188291 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-d200b53b-e7fb-452a-9a99-5cd32b61aa1f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:25.189387 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-d200b53b-e7fb-452a-9a99-5cd32b61aa1f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1403 microversion: 2.20 time: 0.150817 Sep 16 09:51:25.189968 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 63/129] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:51:25 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1403 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:51:25.254348 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-62a13e18-a6fc-434b-a974-56b7709642c7 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:25.255080 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-62a13e18-a6fc-434b-a974-56b7709642c7 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] [instance: 480def5d-9bba-44e0-a53c-65239a428e1c] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:25.261275 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-62a13e18-a6fc-434b-a974-56b7709642c7 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:25.261792 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-62a13e18-a6fc-434b-a974-56b7709642c7 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:25.262218 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-62a13e18-a6fc-434b-a974-56b7709642c7 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:25.262895 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-62a13e18-a6fc-434b-a974-56b7709642c7 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:25.263340 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-62a13e18-a6fc-434b-a974-56b7709642c7 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:25.263755 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-62a13e18-a6fc-434b-a974-56b7709642c7 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:25.390798 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-62a13e18-a6fc-434b-a974-56b7709642c7 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807093ae546a4e42a21c2755f49abc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cca830d4d9384e99b6f499a457776de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:25.399136 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-62a13e18-a6fc-434b-a974-56b7709642c7 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] 10.222.0.73 "GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c" status: 200 len: 1315 microversion: 2.1 time: 0.149282 Sep 16 09:51:25.399710 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 67/130] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:25 2022] GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:25.553373 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-ba98b124-9469-49d9-8afb-4dff36909b23 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:25.554029 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-ba98b124-9469-49d9-8afb-4dff36909b23 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:25.560105 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ba98b124-9469-49d9-8afb-4dff36909b23 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:25.560595 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ba98b124-9469-49d9-8afb-4dff36909b23 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:25.561034 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ba98b124-9469-49d9-8afb-4dff36909b23 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:25.561765 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ba98b124-9469-49d9-8afb-4dff36909b23 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:25.562225 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ba98b124-9469-49d9-8afb-4dff36909b23 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:25.562652 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ba98b124-9469-49d9-8afb-4dff36909b23 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:25.679053 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-3c7242f2-04d4-44da-a609-8103cf30dbce tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:25.679783 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-3c7242f2-04d4-44da-a609-8103cf30dbce tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: efec4ecb-65e7-4ca8-a29f-b87bc9ee1915] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:25.685931 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3c7242f2-04d4-44da-a609-8103cf30dbce tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:25.686410 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3c7242f2-04d4-44da-a609-8103cf30dbce tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:25.686839 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3c7242f2-04d4-44da-a609-8103cf30dbce tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:25.687527 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3c7242f2-04d4-44da-a609-8103cf30dbce tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:25.688149 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3c7242f2-04d4-44da-a609-8103cf30dbce tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:25.688568 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3c7242f2-04d4-44da-a609-8103cf30dbce tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:25.807657 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-ba98b124-9469-49d9-8afb-4dff36909b23 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:25.819884 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-ba98b124-9469-49d9-8afb-4dff36909b23 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1322 microversion: 2.1 time: 0.271255 Sep 16 09:51:25.820475 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 64/131] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:25 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1322 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:25.854106 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-3c7242f2-04d4-44da-a609-8103cf30dbce tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:25.862689 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-3c7242f2-04d4-44da-a609-8103cf30dbce tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915" status: 200 len: 1366 microversion: 2.1 time: 0.188140 Sep 16 09:51:25.865574 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 68/132] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:25 2022] GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:51:26.214719 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-b8e7e63b-91d8-485c-8bff-1d2bdcc7ae0f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:26.215283 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-b8e7e63b-91d8-485c-8bff-1d2bdcc7ae0f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:26.221479 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b8e7e63b-91d8-485c-8bff-1d2bdcc7ae0f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:26.221954 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b8e7e63b-91d8-485c-8bff-1d2bdcc7ae0f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:26.223111 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b8e7e63b-91d8-485c-8bff-1d2bdcc7ae0f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:26.223906 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b8e7e63b-91d8-485c-8bff-1d2bdcc7ae0f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:26.224369 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b8e7e63b-91d8-485c-8bff-1d2bdcc7ae0f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:26.224790 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b8e7e63b-91d8-485c-8bff-1d2bdcc7ae0f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:26.351755 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-b8e7e63b-91d8-485c-8bff-1d2bdcc7ae0f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:26.360057 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-b8e7e63b-91d8-485c-8bff-1d2bdcc7ae0f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:26.361490 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-b8e7e63b-91d8-485c-8bff-1d2bdcc7ae0f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:26.362621 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-b8e7e63b-91d8-485c-8bff-1d2bdcc7ae0f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1403 microversion: 2.20 time: 0.151964 Sep 16 09:51:26.363947 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 65/133] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:51:26 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1403 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:51:26.421729 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-5b2a433e-e655-47e8-8cf0-bb1d1a6464a3 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:26.422334 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-5b2a433e-e655-47e8-8cf0-bb1d1a6464a3 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] [instance: 480def5d-9bba-44e0-a53c-65239a428e1c] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:26.428411 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5b2a433e-e655-47e8-8cf0-bb1d1a6464a3 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:26.428892 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5b2a433e-e655-47e8-8cf0-bb1d1a6464a3 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:26.429315 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5b2a433e-e655-47e8-8cf0-bb1d1a6464a3 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:26.432049 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5b2a433e-e655-47e8-8cf0-bb1d1a6464a3 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:26.432049 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5b2a433e-e655-47e8-8cf0-bb1d1a6464a3 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:26.432049 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5b2a433e-e655-47e8-8cf0-bb1d1a6464a3 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:26.558120 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-5b2a433e-e655-47e8-8cf0-bb1d1a6464a3 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807093ae546a4e42a21c2755f49abc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cca830d4d9384e99b6f499a457776de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:26.565853 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-5b2a433e-e655-47e8-8cf0-bb1d1a6464a3 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] 10.222.0.73 "GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c" status: 200 len: 1315 microversion: 2.1 time: 0.148130 Sep 16 09:51:26.567029 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 69/134] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:26 2022] GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:26.845613 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-70df5f81-8978-4398-8ff5-9c32c72677c6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:26.846248 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-70df5f81-8978-4398-8ff5-9c32c72677c6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:26.852895 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-70df5f81-8978-4398-8ff5-9c32c72677c6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:26.853387 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-70df5f81-8978-4398-8ff5-9c32c72677c6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:26.853894 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-70df5f81-8978-4398-8ff5-9c32c72677c6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:26.854601 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-70df5f81-8978-4398-8ff5-9c32c72677c6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:26.855063 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-70df5f81-8978-4398-8ff5-9c32c72677c6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:26.855491 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-70df5f81-8978-4398-8ff5-9c32c72677c6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:26.888563 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-8443f45e-8ff4-4314-907c-a95c5dceb722 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:26.889533 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-8443f45e-8ff4-4314-907c-a95c5dceb722 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: efec4ecb-65e7-4ca8-a29f-b87bc9ee1915] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:26.898954 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8443f45e-8ff4-4314-907c-a95c5dceb722 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:26.898954 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8443f45e-8ff4-4314-907c-a95c5dceb722 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:26.898954 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8443f45e-8ff4-4314-907c-a95c5dceb722 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:26.898954 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8443f45e-8ff4-4314-907c-a95c5dceb722 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:26.899580 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8443f45e-8ff4-4314-907c-a95c5dceb722 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:26.900032 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8443f45e-8ff4-4314-907c-a95c5dceb722 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:27.028272 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-70df5f81-8978-4398-8ff5-9c32c72677c6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:27.040605 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-70df5f81-8978-4398-8ff5-9c32c72677c6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1322 microversion: 2.1 time: 0.198907 Sep 16 09:51:27.041474 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 66/135] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:26 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:27.073968 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-8443f45e-8ff4-4314-907c-a95c5dceb722 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:27.082072 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-8443f45e-8ff4-4314-907c-a95c5dceb722 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915" status: 200 len: 1366 microversion: 2.1 time: 0.197954 Sep 16 09:51:27.082642 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 70/136] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:26 2022] GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:27.391179 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-ebbf3096-5bfc-4904-ab1f-ee34ca686f58 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:27.392305 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-ebbf3096-5bfc-4904-ab1f-ee34ca686f58 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:27.401623 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ebbf3096-5bfc-4904-ab1f-ee34ca686f58 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:27.402311 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ebbf3096-5bfc-4904-ab1f-ee34ca686f58 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:27.402889 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ebbf3096-5bfc-4904-ab1f-ee34ca686f58 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:27.403791 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ebbf3096-5bfc-4904-ab1f-ee34ca686f58 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:27.404395 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ebbf3096-5bfc-4904-ab1f-ee34ca686f58 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:27.404894 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ebbf3096-5bfc-4904-ab1f-ee34ca686f58 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:27.562984 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-ebbf3096-5bfc-4904-ab1f-ee34ca686f58 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:27.575693 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-ebbf3096-5bfc-4904-ab1f-ee34ca686f58 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:27.577259 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-ebbf3096-5bfc-4904-ab1f-ee34ca686f58 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:27.578442 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-ebbf3096-5bfc-4904-ab1f-ee34ca686f58 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1595 microversion: 2.20 time: 0.193602 Sep 16 09:51:27.578998 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 67/137] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:51:27 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1595 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 09:51:27.589204 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-fdca3cbe-4f22-4a5d-ad42-c985aa11a40e tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:27.589950 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-fdca3cbe-4f22-4a5d-ad42-c985aa11a40e tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] [instance: 480def5d-9bba-44e0-a53c-65239a428e1c] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:27.597223 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-fdca3cbe-4f22-4a5d-ad42-c985aa11a40e tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:27.597981 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-fdca3cbe-4f22-4a5d-ad42-c985aa11a40e tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:27.598461 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-fdca3cbe-4f22-4a5d-ad42-c985aa11a40e tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:27.601049 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-fdca3cbe-4f22-4a5d-ad42-c985aa11a40e tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:27.601774 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-fdca3cbe-4f22-4a5d-ad42-c985aa11a40e tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:27.602406 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-fdca3cbe-4f22-4a5d-ad42-c985aa11a40e tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:27.609526 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d4c2cc90-9db9-49e2-9946-75af62fe1133 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:27.610043 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-d4c2cc90-9db9-49e2-9946-75af62fe1133 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:27.622100 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d4c2cc90-9db9-49e2-9946-75af62fe1133 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:27.623159 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d4c2cc90-9db9-49e2-9946-75af62fe1133 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:27.623159 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d4c2cc90-9db9-49e2-9946-75af62fe1133 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:27.623798 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d4c2cc90-9db9-49e2-9946-75af62fe1133 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:27.624246 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d4c2cc90-9db9-49e2-9946-75af62fe1133 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:27.624685 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d4c2cc90-9db9-49e2-9946-75af62fe1133 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:27.752391 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-d4c2cc90-9db9-49e2-9946-75af62fe1133 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.151294 Sep 16 09:51:27.753011 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 68/138] 10.222.0.73 () {60 vars in 1316 bytes} [Fri Sep 16 09:51:27 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de/os-interface => generated 284 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 16 09:51:27.761683 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-fdca3cbe-4f22-4a5d-ad42-c985aa11a40e tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807093ae546a4e42a21c2755f49abc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cca830d4d9384e99b6f499a457776de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:27.773748 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-fdca3cbe-4f22-4a5d-ad42-c985aa11a40e tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] 10.222.0.73 "GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c" status: 200 len: 1501 microversion: 2.1 time: 0.188439 Sep 16 09:51:27.774801 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 71/139] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:27 2022] GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c => generated 1501 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:51:28.023305 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-710959b2-aa1c-43ce-8d39-c7ee11ec742e req-b7df4986-387a-4ad8-8fc9-ede52b87118e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efec4ecb-65e7-4ca8-a29f-b87bc9ee1915", "name": "network-vif-plugged", "status": "completed", "tag": "70b30d2d-a478-423b-bb6f-8944c8ac74de"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:51:28.034167 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-710959b2-aa1c-43ce-8d39-c7ee11ec742e req-b7df4986-387a-4ad8-8fc9-ede52b87118e service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:28.034925 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-710959b2-aa1c-43ce-8d39-c7ee11ec742e req-b7df4986-387a-4ad8-8fc9-ede52b87118e service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:28.044391 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-710959b2-aa1c-43ce-8d39-c7ee11ec742e req-b7df4986-387a-4ad8-8fc9-ede52b87118e service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:28.057595 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-710959b2-aa1c-43ce-8d39-c7ee11ec742e req-b7df4986-387a-4ad8-8fc9-ede52b87118e service nova] Creating event network-vif-plugged:70b30d2d-a478-423b-bb6f-8944c8ac74de for instance efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 on hv-cinder-79053 Sep 16 09:51:28.068972 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-4dbc50ab-b8ff-47f8-95f4-ffc600f66ca9 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:28.069715 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-4dbc50ab-b8ff-47f8-95f4-ffc600f66ca9 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:28.072493 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-710959b2-aa1c-43ce-8d39-c7ee11ec742e req-b7df4986-387a-4ad8-8fc9-ede52b87118e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053384 Sep 16 09:51:28.074868 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 69/140] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:51:28.080057 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4dbc50ab-b8ff-47f8-95f4-ffc600f66ca9 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:28.080521 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4dbc50ab-b8ff-47f8-95f4-ffc600f66ca9 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:28.080959 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4dbc50ab-b8ff-47f8-95f4-ffc600f66ca9 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:28.083082 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4dbc50ab-b8ff-47f8-95f4-ffc600f66ca9 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:28.083311 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4dbc50ab-b8ff-47f8-95f4-ffc600f66ca9 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:28.083963 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4dbc50ab-b8ff-47f8-95f4-ffc600f66ca9 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:28.108586 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-e591bd25-3089-465e-9d4e-c1fbcfafab82 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:28.109660 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-e591bd25-3089-465e-9d4e-c1fbcfafab82 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: efec4ecb-65e7-4ca8-a29f-b87bc9ee1915] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:28.117408 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e591bd25-3089-465e-9d4e-c1fbcfafab82 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:28.118234 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e591bd25-3089-465e-9d4e-c1fbcfafab82 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:28.118682 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e591bd25-3089-465e-9d4e-c1fbcfafab82 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:28.119385 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e591bd25-3089-465e-9d4e-c1fbcfafab82 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:28.119844 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e591bd25-3089-465e-9d4e-c1fbcfafab82 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:28.120269 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e591bd25-3089-465e-9d4e-c1fbcfafab82 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:28.125026 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=100 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:51:28.302792 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-e591bd25-3089-465e-9d4e-c1fbcfafab82 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:28.310964 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-e591bd25-3089-465e-9d4e-c1fbcfafab82 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915" status: 200 len: 1366 microversion: 2.1 time: 0.208198 Sep 16 09:51:28.311624 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 70/141] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:28 2022] GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:28.661481 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-4dbc50ab-b8ff-47f8-95f4-ffc600f66ca9 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:28.668917 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-4dbc50ab-b8ff-47f8-95f4-ffc600f66ca9 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1322 microversion: 2.1 time: 0.607973 Sep 16 09:51:28.670026 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 72/142] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:28 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1322 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:51:29.337024 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-4c4db310-cc21-4193-927d-350460cdcf7f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:29.338412 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-4c4db310-cc21-4193-927d-350460cdcf7f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: efec4ecb-65e7-4ca8-a29f-b87bc9ee1915] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:29.359917 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4c4db310-cc21-4193-927d-350460cdcf7f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:29.363643 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4c4db310-cc21-4193-927d-350460cdcf7f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:29.365220 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4c4db310-cc21-4193-927d-350460cdcf7f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:29.367900 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4c4db310-cc21-4193-927d-350460cdcf7f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:29.368463 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4c4db310-cc21-4193-927d-350460cdcf7f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:29.368960 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4c4db310-cc21-4193-927d-350460cdcf7f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:29.445744 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [req-c6ea34b0-be8b-46f0-9728-a629c7073c1b req-17ba2fcb-4c15-49b8-8054-167742171748 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88a0813e-ace7-48df-b688-533c8dbc81de", "tag": "55883b34-2ac0-4ba3-b4af-c5503b0d8fc9"}]} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:51:29.455683 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-c6ea34b0-be8b-46f0-9728-a629c7073c1b req-17ba2fcb-4c15-49b8-8054-167742171748 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:29.462176 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-c6ea34b0-be8b-46f0-9728-a629c7073c1b req-17ba2fcb-4c15-49b8-8054-167742171748 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:29.462176 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-c6ea34b0-be8b-46f0-9728-a629c7073c1b req-17ba2fcb-4c15-49b8-8054-167742171748 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:29.468901 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.compute.server_external_events [req-c6ea34b0-be8b-46f0-9728-a629c7073c1b req-17ba2fcb-4c15-49b8-8054-167742171748 service nova] Creating event network-changed:55883b34-2ac0-4ba3-b4af-c5503b0d8fc9 for instance 88a0813e-ace7-48df-b688-533c8dbc81de on hv-cinder-79053 Sep 16 09:51:29.474538 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [req-c6ea34b0-be8b-46f0-9728-a629c7073c1b req-17ba2fcb-4c15-49b8-8054-167742171748 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033241 Sep 16 09:51:29.476097 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 73/143] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 09:51:29.573739 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-4c4db310-cc21-4193-927d-350460cdcf7f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:29.587897 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-4c4db310-cc21-4193-927d-350460cdcf7f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915" status: 200 len: 1366 microversion: 2.1 time: 0.256080 Sep 16 09:51:29.603897 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 71/144] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:29 2022] GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 => generated 1366 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:29.696229 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-7e70f86f-0de5-4b0f-bd62-e5e553694fac tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:29.697263 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-7e70f86f-0de5-4b0f-bd62-e5e553694fac tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:29.703658 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7e70f86f-0de5-4b0f-bd62-e5e553694fac tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:29.704171 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7e70f86f-0de5-4b0f-bd62-e5e553694fac tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:29.704564 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7e70f86f-0de5-4b0f-bd62-e5e553694fac tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:29.705261 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7e70f86f-0de5-4b0f-bd62-e5e553694fac tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:29.705766 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7e70f86f-0de5-4b0f-bd62-e5e553694fac tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:29.706190 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7e70f86f-0de5-4b0f-bd62-e5e553694fac tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:29.870381 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-7e70f86f-0de5-4b0f-bd62-e5e553694fac tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:29.881213 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-7e70f86f-0de5-4b0f-bd62-e5e553694fac tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1322 microversion: 2.1 time: 0.190478 Sep 16 09:51:29.882512 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 74/145] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:29 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:30.103017 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-ccd2c359-116c-4d79-b086-541f9d688e9f req-74242d54-cddc-46e8-9abc-215f9f880518 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6f3fc30-e196-4427-90b4-5d49b56a9b46", "name": "network-vif-plugged", "status": "completed", "tag": "10ea483a-6487-40ad-8b75-adc32be4973b"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:51:30.129574 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-ccd2c359-116c-4d79-b086-541f9d688e9f req-74242d54-cddc-46e8-9abc-215f9f880518 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:30.130798 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-ccd2c359-116c-4d79-b086-541f9d688e9f req-74242d54-cddc-46e8-9abc-215f9f880518 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:30.131644 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-ccd2c359-116c-4d79-b086-541f9d688e9f req-74242d54-cddc-46e8-9abc-215f9f880518 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:30.149680 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-ccd2c359-116c-4d79-b086-541f9d688e9f req-74242d54-cddc-46e8-9abc-215f9f880518 service nova] Creating event network-vif-plugged:10ea483a-6487-40ad-8b75-adc32be4973b for instance a6f3fc30-e196-4427-90b4-5d49b56a9b46 on hv-cinder-79053 Sep 16 09:51:30.154886 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-ccd2c359-116c-4d79-b086-541f9d688e9f req-74242d54-cddc-46e8-9abc-215f9f880518 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061731 Sep 16 09:51:30.155488 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 72/146] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:51:30.193111 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-6170d597-e55b-4f34-8d8d-dc0d3e6c63fb tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0676f778-658d-407a-9f6c-50aa4a2b8895"}} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:51:30.197310 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-6170d597-e55b-4f34-8d8d-dc0d3e6c63fb tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] [instance: 480def5d-9bba-44e0-a53c-65239a428e1c] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:30.201982 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6170d597-e55b-4f34-8d8d-dc0d3e6c63fb tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:30.202456 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6170d597-e55b-4f34-8d8d-dc0d3e6c63fb tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:30.203105 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6170d597-e55b-4f34-8d8d-dc0d3e6c63fb tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:30.203764 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6170d597-e55b-4f34-8d8d-dc0d3e6c63fb tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:30.204370 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6170d597-e55b-4f34-8d8d-dc0d3e6c63fb tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:30.204786 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6170d597-e55b-4f34-8d8d-dc0d3e6c63fb tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:30.614574 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-cd6ccb26-c7ac-43e9-a5b7-5904f0296b86 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:30.615569 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-cd6ccb26-c7ac-43e9-a5b7-5904f0296b86 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: efec4ecb-65e7-4ca8-a29f-b87bc9ee1915] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:30.619730 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_api:SELECT=95 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:51:30.630604 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cd6ccb26-c7ac-43e9-a5b7-5904f0296b86 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:30.636890 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cd6ccb26-c7ac-43e9-a5b7-5904f0296b86 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:30.636890 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cd6ccb26-c7ac-43e9-a5b7-5904f0296b86 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:30.636890 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cd6ccb26-c7ac-43e9-a5b7-5904f0296b86 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:30.636890 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cd6ccb26-c7ac-43e9-a5b7-5904f0296b86 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:30.637611 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cd6ccb26-c7ac-43e9-a5b7-5904f0296b86 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:31.234352 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-cd6ccb26-c7ac-43e9-a5b7-5904f0296b86 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:31.242775 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-cd6ccb26-c7ac-43e9-a5b7-5904f0296b86 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915" status: 200 len: 1366 microversion: 2.1 time: 0.633740 Sep 16 09:51:31.243342 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 73/147] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:30 2022] GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 => generated 1366 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:51:31.247910 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-e70f3242-8412-481b-bc90-65b70cf9703a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:31.248517 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-e70f3242-8412-481b-bc90-65b70cf9703a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:31.255886 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e70f3242-8412-481b-bc90-65b70cf9703a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:31.256387 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e70f3242-8412-481b-bc90-65b70cf9703a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:31.266738 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e70f3242-8412-481b-bc90-65b70cf9703a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:31.266738 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e70f3242-8412-481b-bc90-65b70cf9703a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:31.266738 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e70f3242-8412-481b-bc90-65b70cf9703a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:31.266738 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e70f3242-8412-481b-bc90-65b70cf9703a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:31.515173 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-e70f3242-8412-481b-bc90-65b70cf9703a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:31.527183 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-e70f3242-8412-481b-bc90-65b70cf9703a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1322 microversion: 2.1 time: 0.282036 Sep 16 09:51:31.543506 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 74/148] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:31 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1322 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:32.029324 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-6170d597-e55b-4f34-8d8d-dc0d3e6c63fb tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] 10.222.0.73 "POST /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.840274 Sep 16 09:51:32.036214 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 75/149] 10.222.0.73 () {60 vars in 1323 bytes} [Fri Sep 16 09:51:30 2022] POST /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c/os-volume_attachments => generated 194 bytes in 1842 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:51:32.266620 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-14de422f-af6c-4364-8eb9-a885c841ae94 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:32.267134 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-14de422f-af6c-4364-8eb9-a885c841ae94 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: efec4ecb-65e7-4ca8-a29f-b87bc9ee1915] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:32.274333 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-14de422f-af6c-4364-8eb9-a885c841ae94 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:32.274988 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-14de422f-af6c-4364-8eb9-a885c841ae94 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:32.275266 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-14de422f-af6c-4364-8eb9-a885c841ae94 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:32.276198 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-14de422f-af6c-4364-8eb9-a885c841ae94 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:32.276628 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-14de422f-af6c-4364-8eb9-a885c841ae94 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:32.277043 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-14de422f-af6c-4364-8eb9-a885c841ae94 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:32.463683 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-14de422f-af6c-4364-8eb9-a885c841ae94 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:32.476151 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-14de422f-af6c-4364-8eb9-a885c841ae94 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915" status: 200 len: 1556 microversion: 2.1 time: 0.213413 Sep 16 09:51:32.477079 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 75/150] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:32 2022] GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 => generated 1556 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:32.503665 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-0d0e7778-2efa-47c7-8526-5ffdf1800630 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:32.504933 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-0d0e7778-2efa-47c7-8526-5ffdf1800630 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: efec4ecb-65e7-4ca8-a29f-b87bc9ee1915] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:32.513708 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-0d0e7778-2efa-47c7-8526-5ffdf1800630 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:32.514679 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-0d0e7778-2efa-47c7-8526-5ffdf1800630 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:32.515571 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-0d0e7778-2efa-47c7-8526-5ffdf1800630 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:32.518034 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-0d0e7778-2efa-47c7-8526-5ffdf1800630 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:32.518034 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-0d0e7778-2efa-47c7-8526-5ffdf1800630 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:32.518034 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-0d0e7778-2efa-47c7-8526-5ffdf1800630 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:32.553787 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-f6a17538-f4dd-4dc9-ab88-5a964fc29fc7 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:32.554572 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-f6a17538-f4dd-4dc9-ab88-5a964fc29fc7 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:32.566601 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f6a17538-f4dd-4dc9-ab88-5a964fc29fc7 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:32.568119 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f6a17538-f4dd-4dc9-ab88-5a964fc29fc7 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:32.568646 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f6a17538-f4dd-4dc9-ab88-5a964fc29fc7 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:32.569491 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f6a17538-f4dd-4dc9-ab88-5a964fc29fc7 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:32.570096 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f6a17538-f4dd-4dc9-ab88-5a964fc29fc7 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:32.571460 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f6a17538-f4dd-4dc9-ab88-5a964fc29fc7 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:32.680256 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-0d0e7778-2efa-47c7-8526-5ffdf1800630 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.180578 Sep 16 09:51:32.680931 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 76/151] 10.222.0.73 () {58 vars in 1275 bytes} [Fri Sep 16 09:51:32 2022] GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915/os-interface => generated 284 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:51:32.796895 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f6a17538-f4dd-4dc9-ab88-5a964fc29fc7 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:32.805832 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-f6a17538-f4dd-4dc9-ab88-5a964fc29fc7 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1516 microversion: 2.1 time: 0.258137 Sep 16 09:51:32.806521 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 76/152] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:32 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1516 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:32.829611 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-d266107a-b06c-4aa4-bbe1-877a07961b7b tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:51:32.832526 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-d266107a-b06c-4aa4-bbe1-877a07961b7b tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:32.839310 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d266107a-b06c-4aa4-bbe1-877a07961b7b tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:32.840033 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d266107a-b06c-4aa4-bbe1-877a07961b7b tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:32.842570 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d266107a-b06c-4aa4-bbe1-877a07961b7b tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:32.842570 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d266107a-b06c-4aa4-bbe1-877a07961b7b tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:32.842570 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d266107a-b06c-4aa4-bbe1-877a07961b7b tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:32.842570 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d266107a-b06c-4aa4-bbe1-877a07961b7b tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:32.872965 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.objects.instance [None req-d266107a-b06c-4aa4-bbe1-877a07961b7b tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lazy-loading 'flavor' on Instance uuid a6f3fc30-e196-4427-90b4-5d49b56a9b46 {{(pid=127671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 09:51:33.384724 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-d266107a-b06c-4aa4-bbe1-877a07961b7b tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "POST /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46/action" status: 200 len: 32 microversion: 2.1 time: 0.559379 Sep 16 09:51:33.395563 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-58683c5b-9d0a-4078-bd36-5eea428261af tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:33.396186 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-58683c5b-9d0a-4078-bd36-5eea428261af tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:33.398945 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 77/153] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Sep 16 09:51:32 2022] POST /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46/action => generated 32 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 09:51:33.402334 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-58683c5b-9d0a-4078-bd36-5eea428261af tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:33.402901 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-58683c5b-9d0a-4078-bd36-5eea428261af tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:33.403501 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-58683c5b-9d0a-4078-bd36-5eea428261af tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:33.404288 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-58683c5b-9d0a-4078-bd36-5eea428261af tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:33.404906 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-58683c5b-9d0a-4078-bd36-5eea428261af tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:33.405497 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-58683c5b-9d0a-4078-bd36-5eea428261af tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:33.581063 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-58683c5b-9d0a-4078-bd36-5eea428261af tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:33.594407 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-58683c5b-9d0a-4078-bd36-5eea428261af tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1522 microversion: 2.1 time: 0.203274 Sep 16 09:51:33.601624 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 77/154] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:33 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:34.323979 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [req-fe64599d-eb17-4d8e-99ce-0e1185c36f06 req-962a4b33-e9f2-4b1f-98c4-3c34229a0237 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efec4ecb-65e7-4ca8-a29f-b87bc9ee1915", "tag": "70b30d2d-a478-423b-bb6f-8944c8ac74de"}]} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:51:34.341968 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-fe64599d-eb17-4d8e-99ce-0e1185c36f06 req-962a4b33-e9f2-4b1f-98c4-3c34229a0237 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:34.342864 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-fe64599d-eb17-4d8e-99ce-0e1185c36f06 req-962a4b33-e9f2-4b1f-98c4-3c34229a0237 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:34.343772 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-fe64599d-eb17-4d8e-99ce-0e1185c36f06 req-962a4b33-e9f2-4b1f-98c4-3c34229a0237 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:34.359735 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.compute.server_external_events [req-fe64599d-eb17-4d8e-99ce-0e1185c36f06 req-962a4b33-e9f2-4b1f-98c4-3c34229a0237 service nova] Creating event network-changed:70b30d2d-a478-423b-bb6f-8944c8ac74de for instance efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 on hv-cinder-79053 Sep 16 09:51:34.366899 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [req-fe64599d-eb17-4d8e-99ce-0e1185c36f06 req-962a4b33-e9f2-4b1f-98c4-3c34229a0237 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048544 Sep 16 09:51:34.367960 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 78/155] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:51:34.620138 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-972118fb-d718-4ad0-8e52-c83d71c56688 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:34.621525 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-972118fb-d718-4ad0-8e52-c83d71c56688 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:34.630213 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-972118fb-d718-4ad0-8e52-c83d71c56688 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:34.630705 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-972118fb-d718-4ad0-8e52-c83d71c56688 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:34.631145 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-972118fb-d718-4ad0-8e52-c83d71c56688 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:34.632073 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-972118fb-d718-4ad0-8e52-c83d71c56688 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:34.632498 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-972118fb-d718-4ad0-8e52-c83d71c56688 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:34.632924 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-972118fb-d718-4ad0-8e52-c83d71c56688 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:34.926779 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-972118fb-d718-4ad0-8e52-c83d71c56688 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:34.939437 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-972118fb-d718-4ad0-8e52-c83d71c56688 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1522 microversion: 2.1 time: 0.322718 Sep 16 09:51:34.941854 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 78/156] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:34 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1522 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:35.965001 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-439bf863-664d-4393-b5f0-195045faeb62 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:35.966163 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-439bf863-664d-4393-b5f0-195045faeb62 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:35.974559 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-439bf863-664d-4393-b5f0-195045faeb62 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:35.975702 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-439bf863-664d-4393-b5f0-195045faeb62 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:35.979389 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-439bf863-664d-4393-b5f0-195045faeb62 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:35.979389 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-439bf863-664d-4393-b5f0-195045faeb62 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:35.979389 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-439bf863-664d-4393-b5f0-195045faeb62 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:35.979389 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-439bf863-664d-4393-b5f0-195045faeb62 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:36.135999 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-439bf863-664d-4393-b5f0-195045faeb62 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:36.144511 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-439bf863-664d-4393-b5f0-195045faeb62 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1522 microversion: 2.1 time: 0.183238 Sep 16 09:51:36.145129 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 79/157] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:35 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:37.169220 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-17fbcbd0-9f6d-48d6-b723-eff36da46fb7 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:37.170542 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-17fbcbd0-9f6d-48d6-b723-eff36da46fb7 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:37.177798 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-17fbcbd0-9f6d-48d6-b723-eff36da46fb7 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:37.178340 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-17fbcbd0-9f6d-48d6-b723-eff36da46fb7 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:37.178824 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-17fbcbd0-9f6d-48d6-b723-eff36da46fb7 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:37.179736 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-17fbcbd0-9f6d-48d6-b723-eff36da46fb7 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:37.179885 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-17fbcbd0-9f6d-48d6-b723-eff36da46fb7 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:37.180379 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-17fbcbd0-9f6d-48d6-b723-eff36da46fb7 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:37.326722 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-17fbcbd0-9f6d-48d6-b723-eff36da46fb7 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:37.336499 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-17fbcbd0-9f6d-48d6-b723-eff36da46fb7 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1522 microversion: 2.1 time: 0.172670 Sep 16 09:51:37.337100 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 79/158] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:37 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:38.359655 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-ae26d61a-5127-4955-9e09-cbcd4f924595 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:38.360062 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-ae26d61a-5127-4955-9e09-cbcd4f924595 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:38.364085 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_api:SELECT=91 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:51:38.367809 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ae26d61a-5127-4955-9e09-cbcd4f924595 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:38.368305 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ae26d61a-5127-4955-9e09-cbcd4f924595 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:38.370611 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ae26d61a-5127-4955-9e09-cbcd4f924595 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:38.372773 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ae26d61a-5127-4955-9e09-cbcd4f924595 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:38.373523 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ae26d61a-5127-4955-9e09-cbcd4f924595 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:38.374140 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ae26d61a-5127-4955-9e09-cbcd4f924595 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:38.379539 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:51:38.533453 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-ae26d61a-5127-4955-9e09-cbcd4f924595 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:38.542328 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-ae26d61a-5127-4955-9e09-cbcd4f924595 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1522 microversion: 2.1 time: 0.186523 Sep 16 09:51:38.542902 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 80/159] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:38 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:39.567593 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-900aad1c-89fc-4f50-a8d5-c10e5be5ff14 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:39.568861 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-900aad1c-89fc-4f50-a8d5-c10e5be5ff14 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:39.576426 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-900aad1c-89fc-4f50-a8d5-c10e5be5ff14 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:39.576817 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-900aad1c-89fc-4f50-a8d5-c10e5be5ff14 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:39.577456 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-900aad1c-89fc-4f50-a8d5-c10e5be5ff14 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:39.578470 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-900aad1c-89fc-4f50-a8d5-c10e5be5ff14 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:39.579087 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-900aad1c-89fc-4f50-a8d5-c10e5be5ff14 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:39.579967 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-900aad1c-89fc-4f50-a8d5-c10e5be5ff14 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:39.736673 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-900aad1c-89fc-4f50-a8d5-c10e5be5ff14 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:39.750513 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-900aad1c-89fc-4f50-a8d5-c10e5be5ff14 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1522 microversion: 2.1 time: 0.188526 Sep 16 09:51:39.751108 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 80/160] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:39 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:40.782967 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-774fe4bc-6e14-41e7-aafe-8b71f6c3afaf tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:40.783621 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-774fe4bc-6e14-41e7-aafe-8b71f6c3afaf tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:40.792442 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-774fe4bc-6e14-41e7-aafe-8b71f6c3afaf tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:40.792924 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-774fe4bc-6e14-41e7-aafe-8b71f6c3afaf tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:40.793363 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-774fe4bc-6e14-41e7-aafe-8b71f6c3afaf tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:40.794082 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-774fe4bc-6e14-41e7-aafe-8b71f6c3afaf tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:40.794534 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-774fe4bc-6e14-41e7-aafe-8b71f6c3afaf tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:40.794954 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-774fe4bc-6e14-41e7-aafe-8b71f6c3afaf tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:40.928541 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-774fe4bc-6e14-41e7-aafe-8b71f6c3afaf tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:40.936399 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-774fe4bc-6e14-41e7-aafe-8b71f6c3afaf tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1522 microversion: 2.1 time: 0.157733 Sep 16 09:51:40.936979 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 81/161] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:40 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:41.961265 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-814e9558-c676-4e55-aea2-a99dbe70e742 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:41.962034 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-814e9558-c676-4e55-aea2-a99dbe70e742 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:41.969068 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-814e9558-c676-4e55-aea2-a99dbe70e742 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:41.969685 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-814e9558-c676-4e55-aea2-a99dbe70e742 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:41.970909 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-814e9558-c676-4e55-aea2-a99dbe70e742 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:41.972215 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-814e9558-c676-4e55-aea2-a99dbe70e742 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:41.973764 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-814e9558-c676-4e55-aea2-a99dbe70e742 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:41.974708 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-814e9558-c676-4e55-aea2-a99dbe70e742 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:42.146626 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-814e9558-c676-4e55-aea2-a99dbe70e742 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:42.156043 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-814e9558-c676-4e55-aea2-a99dbe70e742 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1522 microversion: 2.1 time: 0.199410 Sep 16 09:51:42.156857 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 81/162] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:41 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:51:42.731214 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-05fc3163-ff8d-47a7-a717-2a1d068f29a3 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:42.731863 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-05fc3163-ff8d-47a7-a717-2a1d068f29a3 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] [instance: 480def5d-9bba-44e0-a53c-65239a428e1c] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:42.739535 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-05fc3163-ff8d-47a7-a717-2a1d068f29a3 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:42.740040 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-05fc3163-ff8d-47a7-a717-2a1d068f29a3 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:42.740483 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-05fc3163-ff8d-47a7-a717-2a1d068f29a3 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:42.741433 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-05fc3163-ff8d-47a7-a717-2a1d068f29a3 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:42.741928 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-05fc3163-ff8d-47a7-a717-2a1d068f29a3 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:42.742350 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-05fc3163-ff8d-47a7-a717-2a1d068f29a3 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:42.768796 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-05fc3163-ff8d-47a7-a717-2a1d068f29a3 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] [instance: 480def5d-9bba-44e0-a53c-65239a428e1c] Going to try to terminate instance {{(pid=127671) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 09:51:43.071481 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-05fc3163-ff8d-47a7-a717-2a1d068f29a3 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] 10.222.0.73 "DELETE /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c" status: 204 len: 0 microversion: 2.1 time: 0.343939 Sep 16 09:51:43.072150 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 82/163] 10.222.0.73 () {58 vars in 1239 bytes} [Fri Sep 16 09:51:42 2022] DELETE /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 09:51:43.080794 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-e659913a-0871-494d-98ba-6bf009dd2830 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:43.081418 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-e659913a-0871-494d-98ba-6bf009dd2830 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] [instance: 480def5d-9bba-44e0-a53c-65239a428e1c] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:43.087947 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e659913a-0871-494d-98ba-6bf009dd2830 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:43.088440 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e659913a-0871-494d-98ba-6bf009dd2830 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:43.088883 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e659913a-0871-494d-98ba-6bf009dd2830 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:43.089615 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e659913a-0871-494d-98ba-6bf009dd2830 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:43.090083 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e659913a-0871-494d-98ba-6bf009dd2830 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:43.090687 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e659913a-0871-494d-98ba-6bf009dd2830 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:43.182834 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-a59ad3aa-bc02-4b88-8d9d-eacdbad86632 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:43.183924 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-a59ad3aa-bc02-4b88-8d9d-eacdbad86632 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:43.191833 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a59ad3aa-bc02-4b88-8d9d-eacdbad86632 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:43.192174 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a59ad3aa-bc02-4b88-8d9d-eacdbad86632 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:43.193611 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a59ad3aa-bc02-4b88-8d9d-eacdbad86632 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:43.194653 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a59ad3aa-bc02-4b88-8d9d-eacdbad86632 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:43.195266 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a59ad3aa-bc02-4b88-8d9d-eacdbad86632 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:43.195844 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a59ad3aa-bc02-4b88-8d9d-eacdbad86632 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:43.232277 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-e659913a-0871-494d-98ba-6bf009dd2830 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807093ae546a4e42a21c2755f49abc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cca830d4d9384e99b6f499a457776de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:43.243547 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-e659913a-0871-494d-98ba-6bf009dd2830 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] 10.222.0.73 "GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c" status: 200 len: 1553 microversion: 2.1 time: 0.166520 Sep 16 09:51:43.255037 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 82/164] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:43 2022] GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c => generated 1553 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:43.367334 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-a59ad3aa-bc02-4b88-8d9d-eacdbad86632 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:43.375949 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-a59ad3aa-bc02-4b88-8d9d-eacdbad86632 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1522 microversion: 2.1 time: 0.197426 Sep 16 09:51:43.389800 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 83/165] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:43 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:44.266702 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-4f8fb363-6899-4871-a518-eba3bd654d42 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:44.267315 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-4f8fb363-6899-4871-a518-eba3bd654d42 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] [instance: 480def5d-9bba-44e0-a53c-65239a428e1c] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:44.273291 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4f8fb363-6899-4871-a518-eba3bd654d42 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:44.273810 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4f8fb363-6899-4871-a518-eba3bd654d42 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:44.274246 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4f8fb363-6899-4871-a518-eba3bd654d42 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:44.274945 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4f8fb363-6899-4871-a518-eba3bd654d42 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:44.275402 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4f8fb363-6899-4871-a518-eba3bd654d42 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:44.275828 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4f8fb363-6899-4871-a518-eba3bd654d42 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:44.401194 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-cf190f7a-bdb3-452d-8791-c5ada97fc7ce tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:44.401998 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-cf190f7a-bdb3-452d-8791-c5ada97fc7ce tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:44.410617 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-4f8fb363-6899-4871-a518-eba3bd654d42 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807093ae546a4e42a21c2755f49abc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cca830d4d9384e99b6f499a457776de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:44.411019 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-cf190f7a-bdb3-452d-8791-c5ada97fc7ce tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:44.411532 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-cf190f7a-bdb3-452d-8791-c5ada97fc7ce tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:44.412030 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-cf190f7a-bdb3-452d-8791-c5ada97fc7ce tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:44.412729 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-cf190f7a-bdb3-452d-8791-c5ada97fc7ce tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:44.415094 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-cf190f7a-bdb3-452d-8791-c5ada97fc7ce tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:44.415745 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-cf190f7a-bdb3-452d-8791-c5ada97fc7ce tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:44.426251 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-4f8fb363-6899-4871-a518-eba3bd654d42 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] 10.222.0.73 "GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c" status: 200 len: 1553 microversion: 2.1 time: 0.158406 Sep 16 09:51:44.426251 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 83/166] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:44 2022] GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:44.596806 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-cf190f7a-bdb3-452d-8791-c5ada97fc7ce tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:44.607744 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-cf190f7a-bdb3-452d-8791-c5ada97fc7ce tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1522 microversion: 2.1 time: 0.211677 Sep 16 09:51:44.611147 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 84/167] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:44 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:45.453218 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-db95a20c-5851-4b10-801b-57dc1408e08e tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:45.461168 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-db95a20c-5851-4b10-801b-57dc1408e08e tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] [instance: 480def5d-9bba-44e0-a53c-65239a428e1c] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:45.464145 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-db95a20c-5851-4b10-801b-57dc1408e08e tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:45.465807 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-db95a20c-5851-4b10-801b-57dc1408e08e tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:45.466374 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-db95a20c-5851-4b10-801b-57dc1408e08e tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:45.467550 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-db95a20c-5851-4b10-801b-57dc1408e08e tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:45.471274 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-db95a20c-5851-4b10-801b-57dc1408e08e tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:45.471274 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-db95a20c-5851-4b10-801b-57dc1408e08e tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:45.646128 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-e9b442d8-5948-41ea-ac82-80cc1d72757a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:45.647283 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-e9b442d8-5948-41ea-ac82-80cc1d72757a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:45.673248 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e9b442d8-5948-41ea-ac82-80cc1d72757a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:45.673248 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e9b442d8-5948-41ea-ac82-80cc1d72757a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:45.673248 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e9b442d8-5948-41ea-ac82-80cc1d72757a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:45.673248 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e9b442d8-5948-41ea-ac82-80cc1d72757a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:45.674483 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e9b442d8-5948-41ea-ac82-80cc1d72757a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:45.675164 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e9b442d8-5948-41ea-ac82-80cc1d72757a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:45.813308 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-db95a20c-5851-4b10-801b-57dc1408e08e tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807093ae546a4e42a21c2755f49abc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cca830d4d9384e99b6f499a457776de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:45.822366 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-db95a20c-5851-4b10-801b-57dc1408e08e tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] 10.222.0.73 "GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c" status: 200 len: 1553 microversion: 2.1 time: 0.375134 Sep 16 09:51:45.822948 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 84/168] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:45 2022] GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c => generated 1553 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:51:45.969701 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-e9b442d8-5948-41ea-ac82-80cc1d72757a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:45.980519 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-e9b442d8-5948-41ea-ac82-80cc1d72757a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1522 microversion: 2.1 time: 0.348780 Sep 16 09:51:45.981702 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 85/169] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:45 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1522 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:46.671463 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-c3cb9842-03bd-41fd-8ea0-4a247c1a7a44 req-d9a3b375-4fe5-4999-a6ed-7789e65614d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "480def5d-9bba-44e0-a53c-65239a428e1c", "name": "network-vif-deleted", "tag": "c050f3bc-122c-4343-b68a-ba8664cb732b"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:51:46.691986 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-c3cb9842-03bd-41fd-8ea0-4a247c1a7a44 req-d9a3b375-4fe5-4999-a6ed-7789e65614d1 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:46.695352 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-c3cb9842-03bd-41fd-8ea0-4a247c1a7a44 req-d9a3b375-4fe5-4999-a6ed-7789e65614d1 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:46.697265 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-c3cb9842-03bd-41fd-8ea0-4a247c1a7a44 req-d9a3b375-4fe5-4999-a6ed-7789e65614d1 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:46.716530 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-c3cb9842-03bd-41fd-8ea0-4a247c1a7a44 req-d9a3b375-4fe5-4999-a6ed-7789e65614d1 service nova] Creating event network-vif-deleted:c050f3bc-122c-4343-b68a-ba8664cb732b for instance 480def5d-9bba-44e0-a53c-65239a428e1c on hv-cinder-79053 Sep 16 09:51:46.722449 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-c3cb9842-03bd-41fd-8ea0-4a247c1a7a44 req-d9a3b375-4fe5-4999-a6ed-7789e65614d1 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056530 Sep 16 09:51:46.723415 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 85/170] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:51:46.846366 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-11316d2a-110a-47c7-ab55-efd1aba644c2 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:46.847206 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-11316d2a-110a-47c7-ab55-efd1aba644c2 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] [instance: 480def5d-9bba-44e0-a53c-65239a428e1c] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:46.854447 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-11316d2a-110a-47c7-ab55-efd1aba644c2 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:46.855285 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-11316d2a-110a-47c7-ab55-efd1aba644c2 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:46.855716 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-11316d2a-110a-47c7-ab55-efd1aba644c2 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:46.856425 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-11316d2a-110a-47c7-ab55-efd1aba644c2 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:46.856912 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-11316d2a-110a-47c7-ab55-efd1aba644c2 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:46.857362 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-11316d2a-110a-47c7-ab55-efd1aba644c2 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:46.933964 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-11316d2a-110a-47c7-ab55-efd1aba644c2 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807093ae546a4e42a21c2755f49abc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cca830d4d9384e99b6f499a457776de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:46.949801 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-11316d2a-110a-47c7-ab55-efd1aba644c2 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] 10.222.0.73 "GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c" status: 200 len: 1346 microversion: 2.1 time: 0.107244 Sep 16 09:51:46.950823 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 86/171] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:46 2022] GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c => generated 1346 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:47.005730 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-15e68db1-4b7e-40d5-8368-341774bbb4e2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:47.006515 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-15e68db1-4b7e-40d5-8368-341774bbb4e2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:47.012709 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-15e68db1-4b7e-40d5-8368-341774bbb4e2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:47.013191 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-15e68db1-4b7e-40d5-8368-341774bbb4e2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:47.013659 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-15e68db1-4b7e-40d5-8368-341774bbb4e2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:47.014350 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-15e68db1-4b7e-40d5-8368-341774bbb4e2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:47.014795 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-15e68db1-4b7e-40d5-8368-341774bbb4e2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:47.015213 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-15e68db1-4b7e-40d5-8368-341774bbb4e2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:47.239572 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-15e68db1-4b7e-40d5-8368-341774bbb4e2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:47.257679 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-15e68db1-4b7e-40d5-8368-341774bbb4e2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1522 microversion: 2.1 time: 0.252882 Sep 16 09:51:47.258307 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 86/172] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:46 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:47.975556 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-db529651-791a-4c96-b09b-b80a4e499bef tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:47.976249 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-db529651-791a-4c96-b09b-b80a4e499bef tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] [instance: 480def5d-9bba-44e0-a53c-65239a428e1c] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:47.983013 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-db529651-791a-4c96-b09b-b80a4e499bef tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:47.983572 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-db529651-791a-4c96-b09b-b80a4e499bef tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:47.991783 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-db529651-791a-4c96-b09b-b80a4e499bef tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:47.991783 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-db529651-791a-4c96-b09b-b80a4e499bef tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:47.991783 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-db529651-791a-4c96-b09b-b80a4e499bef tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:47.991783 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-db529651-791a-4c96-b09b-b80a4e499bef tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:48.022513 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-db529651-791a-4c96-b09b-b80a4e499bef tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:48.023329 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-db529651-791a-4c96-b09b-b80a4e499bef tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:48.023979 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-db529651-791a-4c96-b09b-b80a4e499bef tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:48.024638 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.objects.instance [None req-db529651-791a-4c96-b09b-b80a4e499bef tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lazy-loading 'fault' on Instance uuid 480def5d-9bba-44e0-a53c-65239a428e1c {{(pid=127671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 09:51:48.079497 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-db529651-791a-4c96-b09b-b80a4e499bef tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807093ae546a4e42a21c2755f49abc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cca830d4d9384e99b6f499a457776de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:48.090870 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-db529651-791a-4c96-b09b-b80a4e499bef tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] 10.222.0.73 "GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c" status: 200 len: 1351 microversion: 2.1 time: 0.120376 Sep 16 09:51:48.103040 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 87/173] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:47 2022] GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c => generated 1351 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:48.282696 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-b2290635-e8d5-4455-ad95-b9af9405838b tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:48.283606 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-b2290635-e8d5-4455-ad95-b9af9405838b tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:48.291606 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b2290635-e8d5-4455-ad95-b9af9405838b tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:48.292195 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b2290635-e8d5-4455-ad95-b9af9405838b tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:48.292710 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b2290635-e8d5-4455-ad95-b9af9405838b tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:48.293856 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b2290635-e8d5-4455-ad95-b9af9405838b tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:48.294642 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b2290635-e8d5-4455-ad95-b9af9405838b tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:48.295370 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b2290635-e8d5-4455-ad95-b9af9405838b tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:48.459556 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-b2290635-e8d5-4455-ad95-b9af9405838b tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:48.467723 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-b2290635-e8d5-4455-ad95-b9af9405838b tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1522 microversion: 2.1 time: 0.189199 Sep 16 09:51:48.468306 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 87/174] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:48 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:49.120942 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-6061ad88-b21e-4174-9c59-c6b144639cda tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:49.121581 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-6061ad88-b21e-4174-9c59-c6b144639cda tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] [instance: 480def5d-9bba-44e0-a53c-65239a428e1c] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:49.128337 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6061ad88-b21e-4174-9c59-c6b144639cda tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:49.128854 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6061ad88-b21e-4174-9c59-c6b144639cda tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:49.129300 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6061ad88-b21e-4174-9c59-c6b144639cda tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:49.130106 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6061ad88-b21e-4174-9c59-c6b144639cda tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:49.130728 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6061ad88-b21e-4174-9c59-c6b144639cda tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:49.131326 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6061ad88-b21e-4174-9c59-c6b144639cda tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:49.145531 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.wsgi [None req-6061ad88-b21e-4174-9c59-c6b144639cda tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] HTTP exception thrown: Instance 480def5d-9bba-44e0-a53c-65239a428e1c could not be found. Sep 16 09:51:49.150560 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-6061ad88-b21e-4174-9c59-c6b144639cda tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Request method failure captured: Sep 16 09:51:49.150560 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: request: GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c HTTP/1.1 Sep 16 09:51:49.150560 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept: application/json Sep 16 09:51:49.150560 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept-Encoding: identity Sep 16 09:51:49.150560 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Connection: close Sep 16 09:51:49.150560 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Length: 0 Sep 16 09:51:49.150560 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Type: application/json Sep 16 09:51:49.150560 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Host: 10.222.0.73 Sep 16 09:51:49.150560 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Openstack-System-Scope: None Sep 16 09:51:49.150560 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: User-Agent: python-urllib3/1.26.12 Sep 16 09:51:49.150560 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Auth-Token: gAAAAABjJEbziUY_PEDWhlG7Wdp21ZdlyprwmLStOq95ekImroPr5YvsViebJKEOVL5bDDXZyltmnqVxChliCyt4PErvklluhNzDYzbp66O3m0DXwY2_nFZ_IAEqaqX0lQv9F39yfc65rVuGC7pSx73lr08MWZ0dcJz_3cdwz6YlW9zjZ80CNg8 Sep 16 09:51:49.150560 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Id: None Sep 16 09:51:49.150560 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Name: None Sep 16 09:51:49.150560 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Identity-Status: Confirmed Sep 16 09:51:49.150560 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Is-Admin-Project: True Sep 16 09:51:49.150560 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Id: default Sep 16 09:51:49.150560 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Name: Default Sep 16 09:51:49.150560 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Id: cca830d4d9384e99b6f499a457776de4 Sep 16 09:51:49.150560 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Name: tempest-DeleteServersTestJSON-1133296427 Sep 16 09:51:49.150560 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Role: reader,member Sep 16 09:51:49.150560 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Roles: reader,member Sep 16 09:51:49.151979 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/cca830d4d9384e99b6f499a457776de4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_cca830d4d9384e99b6f499a457776de4", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/cca830d4d9384e99b6f499a457776de4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/cca830d4d9384e99b6f499a457776de4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 09:51:49.151979 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant: tempest-DeleteServersTestJSON-1133296427 Sep 16 09:51:49.151979 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Id: cca830d4d9384e99b6f499a457776de4 Sep 16 09:51:49.151979 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Name: tempest-DeleteServersTestJSON-1133296427 Sep 16 09:51:49.151979 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User: tempest-DeleteServersTestJSON-1133296427-project Sep 16 09:51:49.151979 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Id: default Sep 16 09:51:49.151979 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Name: Default Sep 16 09:51:49.151979 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Id: 807093ae546a4e42a21c2755f49abc59 Sep 16 09:51:49.151979 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Name: tempest-DeleteServersTestJSON-1133296427-project Sep 16 09:51:49.151979 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: method: > Sep 16 09:51:49.151979 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: exception: Instance 480def5d-9bba-44e0-a53c-65239a428e1c could not be found. Sep 16 09:51:49.151979 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: action_args: {'id': '480def5d-9bba-44e0-a53c-65239a428e1c'} Sep 16 09:51:49.152827 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 09:51:49.152827 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:51:49.152827 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 09:51:49.152827 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 09:51:49.152827 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 09:51:49.152827 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 09:51:49.152827 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 09:51:49.152827 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 09:51:49.152827 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 09:51:49.152827 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 09:51:49.152827 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 480def5d-9bba-44e0-a53c-65239a428e1c could not be found. Sep 16 09:51:49.152827 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:51:49.152827 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:51:49.152827 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:51:49.152827 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:51:49.152827 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:51:49.152827 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:51:49.152827 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 09:51:49.152827 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 09:51:49.152827 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 09:51:49.154346 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:51:49.154346 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 09:51:49.154346 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 09:51:49.154346 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 09:51:49.154346 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 09:51:49.154346 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 09:51:49.154346 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 09:51:49.154346 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 480def5d-9bba-44e0-a53c-65239a428e1c could not be found. Sep 16 09:51:49.154346 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:51:49.154346 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:51:49.154346 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:51:49.154346 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:51:49.154346 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:51:49.154346 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:51:49.154346 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 09:51:49.154346 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 09:51:49.154346 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 480def5d-9bba-44e0-a53c-65239a428e1c could not be found. Sep 16 09:51:49.154346 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:51:49.155535 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-6061ad88-b21e-4174-9c59-c6b144639cda tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Returning 404 to user: Instance 480def5d-9bba-44e0-a53c-65239a428e1c could not be found. {{(pid=127671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 09:51:49.155535 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-6061ad88-b21e-4174-9c59-c6b144639cda tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] 10.222.0.73 "GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c" status: 404 len: 111 microversion: 2.1 time: 0.035358 Sep 16 09:51:49.156657 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 88/175] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:49 2022] GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 09:51:49.281887 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-9d2619d1-e7c2-4ad8-8e34-0f9cb1695d03 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:49.284342 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-9d2619d1-e7c2-4ad8-8e34-0f9cb1695d03 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] [instance: 480def5d-9bba-44e0-a53c-65239a428e1c] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:49.307740 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9d2619d1-e7c2-4ad8-8e34-0f9cb1695d03 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:49.308313 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9d2619d1-e7c2-4ad8-8e34-0f9cb1695d03 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:49.308689 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9d2619d1-e7c2-4ad8-8e34-0f9cb1695d03 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:49.309404 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9d2619d1-e7c2-4ad8-8e34-0f9cb1695d03 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:49.309953 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9d2619d1-e7c2-4ad8-8e34-0f9cb1695d03 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:49.310424 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9d2619d1-e7c2-4ad8-8e34-0f9cb1695d03 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:49.318249 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=100 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:51:49.326199 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.wsgi [None req-9d2619d1-e7c2-4ad8-8e34-0f9cb1695d03 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] HTTP exception thrown: Instance 480def5d-9bba-44e0-a53c-65239a428e1c could not be found. Sep 16 09:51:49.330452 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-9d2619d1-e7c2-4ad8-8e34-0f9cb1695d03 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Request method failure captured: Sep 16 09:51:49.330452 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: request: GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c/os-volume_attachments HTTP/1.1 Sep 16 09:51:49.330452 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept: application/json Sep 16 09:51:49.330452 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Sep 16 09:51:49.330452 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Connection: close Sep 16 09:51:49.330452 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Length: 0 Sep 16 09:51:49.330452 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Type: application/json Sep 16 09:51:49.330452 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Host: 10.222.0.73 Sep 16 09:51:49.330452 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Sep 16 09:51:49.330452 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Sep 16 09:51:49.330452 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjJEbziUY_PEDWhlG7Wdp21ZdlyprwmLStOq95ekImroPr5YvsViebJKEOVL5bDDXZyltmnqVxChliCyt4PErvklluhNzDYzbp66O3m0DXwY2_nFZ_IAEqaqX0lQv9F39yfc65rVuGC7pSx73lr08MWZ0dcJz_3cdwz6YlW9zjZ80CNg8 Sep 16 09:51:49.330452 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Sep 16 09:51:49.330452 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Sep 16 09:51:49.330452 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Sep 16 09:51:49.330452 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Sep 16 09:51:49.330452 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Sep 16 09:51:49.330452 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Sep 16 09:51:49.330452 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Id: cca830d4d9384e99b6f499a457776de4 Sep 16 09:51:49.330452 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-DeleteServersTestJSON-1133296427 Sep 16 09:51:49.330452 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Role: reader,member Sep 16 09:51:49.330452 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Roles: reader,member Sep 16 09:51:49.331838 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/cca830d4d9384e99b6f499a457776de4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_cca830d4d9384e99b6f499a457776de4", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/cca830d4d9384e99b6f499a457776de4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/cca830d4d9384e99b6f499a457776de4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 09:51:49.331838 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-DeleteServersTestJSON-1133296427 Sep 16 09:51:49.331838 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Id: cca830d4d9384e99b6f499a457776de4 Sep 16 09:51:49.331838 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-DeleteServersTestJSON-1133296427 Sep 16 09:51:49.331838 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User: tempest-DeleteServersTestJSON-1133296427-project Sep 16 09:51:49.331838 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Sep 16 09:51:49.331838 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Sep 16 09:51:49.331838 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Id: 807093ae546a4e42a21c2755f49abc59 Sep 16 09:51:49.331838 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-DeleteServersTestJSON-1133296427-project Sep 16 09:51:49.331838 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: method: > Sep 16 09:51:49.331838 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: exception: Instance 480def5d-9bba-44e0-a53c-65239a428e1c could not be found. Sep 16 09:51:49.331838 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: action_args: {'server_id': '480def5d-9bba-44e0-a53c-65239a428e1c'} Sep 16 09:51:49.332504 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 09:51:49.332504 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:51:49.332504 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 09:51:49.332504 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 09:51:49.332504 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 09:51:49.332504 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 09:51:49.332504 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 09:51:49.332504 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 09:51:49.332504 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 09:51:49.332504 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 09:51:49.332504 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 480def5d-9bba-44e0-a53c-65239a428e1c could not be found. Sep 16 09:51:49.332504 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:51:49.332504 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:51:49.332504 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:51:49.332504 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:51:49.332504 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:51:49.332504 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:51:49.332504 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 09:51:49.332504 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 09:51:49.332504 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 09:51:49.333669 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:51:49.333669 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 16 09:51:49.333669 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 09:51:49.333669 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 16 09:51:49.333669 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 09:51:49.333669 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 16 09:51:49.333669 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 16 09:51:49.333669 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 09:51:49.333669 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 09:51:49.333669 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 480def5d-9bba-44e0-a53c-65239a428e1c could not be found. Sep 16 09:51:49.333669 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:51:49.333669 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:51:49.333669 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:51:49.333669 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:51:49.333669 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:51:49.333669 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:51:49.333669 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 09:51:49.333669 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 09:51:49.333669 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 480def5d-9bba-44e0-a53c-65239a428e1c could not be found. Sep 16 09:51:49.333669 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:51:49.334853 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-9d2619d1-e7c2-4ad8-8e34-0f9cb1695d03 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Returning 404 to user: Instance 480def5d-9bba-44e0-a53c-65239a428e1c could not be found. {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 09:51:49.334853 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-9d2619d1-e7c2-4ad8-8e34-0f9cb1695d03 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] 10.222.0.73 "GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.054240 Sep 16 09:51:49.334853 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 88/176] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Sep 16 09:51:49 2022] GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c/os-volume_attachments => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 09:51:49.490962 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-7bf9f4c5-ef48-4dec-954a-f3c5328899ef tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:49.491704 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-7bf9f4c5-ef48-4dec-954a-f3c5328899ef tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:49.498123 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7bf9f4c5-ef48-4dec-954a-f3c5328899ef tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:49.498697 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7bf9f4c5-ef48-4dec-954a-f3c5328899ef tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:49.499296 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7bf9f4c5-ef48-4dec-954a-f3c5328899ef tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:49.500134 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7bf9f4c5-ef48-4dec-954a-f3c5328899ef tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:49.500666 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7bf9f4c5-ef48-4dec-954a-f3c5328899ef tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:49.501108 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7bf9f4c5-ef48-4dec-954a-f3c5328899ef tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:49.657475 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-7bf9f4c5-ef48-4dec-954a-f3c5328899ef tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:49.667129 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-7bf9f4c5-ef48-4dec-954a-f3c5328899ef tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1522 microversion: 2.1 time: 0.180608 Sep 16 09:51:49.667700 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 89/177] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:49 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:50.690057 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-2d94c30b-ae92-42bd-897e-de2a5dbdcd1a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:50.696890 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-2d94c30b-ae92-42bd-897e-de2a5dbdcd1a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:50.697861 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2d94c30b-ae92-42bd-897e-de2a5dbdcd1a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:50.698353 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2d94c30b-ae92-42bd-897e-de2a5dbdcd1a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:50.698786 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2d94c30b-ae92-42bd-897e-de2a5dbdcd1a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:50.699490 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2d94c30b-ae92-42bd-897e-de2a5dbdcd1a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:50.699950 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2d94c30b-ae92-42bd-897e-de2a5dbdcd1a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:50.700416 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2d94c30b-ae92-42bd-897e-de2a5dbdcd1a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:50.812386 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-4949644b-ee37-4591-b37f-43ccbac97c10 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:50.812886 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-4949644b-ee37-4591-b37f-43ccbac97c10 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] [instance: 480def5d-9bba-44e0-a53c-65239a428e1c] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:50.820072 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4949644b-ee37-4591-b37f-43ccbac97c10 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:50.822986 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4949644b-ee37-4591-b37f-43ccbac97c10 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:50.822986 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4949644b-ee37-4591-b37f-43ccbac97c10 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:50.822986 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4949644b-ee37-4591-b37f-43ccbac97c10 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:50.822986 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4949644b-ee37-4591-b37f-43ccbac97c10 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:50.823349 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4949644b-ee37-4591-b37f-43ccbac97c10 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:50.840253 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.wsgi [None req-4949644b-ee37-4591-b37f-43ccbac97c10 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] HTTP exception thrown: Instance 480def5d-9bba-44e0-a53c-65239a428e1c could not be found. Sep 16 09:51:50.841727 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-2d94c30b-ae92-42bd-897e-de2a5dbdcd1a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:50.841843 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-4949644b-ee37-4591-b37f-43ccbac97c10 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Request method failure captured: Sep 16 09:51:50.841843 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: request: DELETE /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c HTTP/1.1 Sep 16 09:51:50.841843 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept: application/json Sep 16 09:51:50.841843 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept-Encoding: identity Sep 16 09:51:50.841843 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Connection: close Sep 16 09:51:50.841843 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Length: 0 Sep 16 09:51:50.841843 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Type: application/json Sep 16 09:51:50.841843 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Host: 10.222.0.73 Sep 16 09:51:50.841843 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Openstack-System-Scope: None Sep 16 09:51:50.841843 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: User-Agent: python-urllib3/1.26.12 Sep 16 09:51:50.841843 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Auth-Token: gAAAAABjJEbziUY_PEDWhlG7Wdp21ZdlyprwmLStOq95ekImroPr5YvsViebJKEOVL5bDDXZyltmnqVxChliCyt4PErvklluhNzDYzbp66O3m0DXwY2_nFZ_IAEqaqX0lQv9F39yfc65rVuGC7pSx73lr08MWZ0dcJz_3cdwz6YlW9zjZ80CNg8 Sep 16 09:51:50.841843 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Id: None Sep 16 09:51:50.841843 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Name: None Sep 16 09:51:50.841843 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Identity-Status: Confirmed Sep 16 09:51:50.841843 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Is-Admin-Project: True Sep 16 09:51:50.841843 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Id: default Sep 16 09:51:50.841843 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Name: Default Sep 16 09:51:50.841843 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Id: cca830d4d9384e99b6f499a457776de4 Sep 16 09:51:50.841843 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Name: tempest-DeleteServersTestJSON-1133296427 Sep 16 09:51:50.841843 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Role: reader,member Sep 16 09:51:50.841843 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Roles: reader,member Sep 16 09:51:50.843343 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/cca830d4d9384e99b6f499a457776de4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_cca830d4d9384e99b6f499a457776de4", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/cca830d4d9384e99b6f499a457776de4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/cca830d4d9384e99b6f499a457776de4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 09:51:50.843343 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant: tempest-DeleteServersTestJSON-1133296427 Sep 16 09:51:50.843343 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Id: cca830d4d9384e99b6f499a457776de4 Sep 16 09:51:50.843343 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Name: tempest-DeleteServersTestJSON-1133296427 Sep 16 09:51:50.843343 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User: tempest-DeleteServersTestJSON-1133296427-project Sep 16 09:51:50.843343 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Id: default Sep 16 09:51:50.843343 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Name: Default Sep 16 09:51:50.843343 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Id: 807093ae546a4e42a21c2755f49abc59 Sep 16 09:51:50.843343 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Name: tempest-DeleteServersTestJSON-1133296427-project Sep 16 09:51:50.843343 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: method: > Sep 16 09:51:50.843343 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: exception: Instance 480def5d-9bba-44e0-a53c-65239a428e1c could not be found. Sep 16 09:51:50.843343 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: action_args: {'id': '480def5d-9bba-44e0-a53c-65239a428e1c'} Sep 16 09:51:50.844545 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 09:51:50.844545 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:51:50.844545 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 09:51:50.844545 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 09:51:50.844545 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 09:51:50.844545 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 09:51:50.844545 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 09:51:50.844545 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 09:51:50.844545 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 09:51:50.844545 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 09:51:50.844545 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 480def5d-9bba-44e0-a53c-65239a428e1c could not be found. Sep 16 09:51:50.844545 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:51:50.844545 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:51:50.844545 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:51:50.844545 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:51:50.844545 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:51:50.844545 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:51:50.844545 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 09:51:50.844545 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 09:51:50.844545 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 09:51:50.845785 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:51:50.845785 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 09:51:50.845785 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 09:51:50.845785 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 09:51:50.845785 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 09:51:50.845785 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 09:51:50.845785 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 09:51:50.845785 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 09:51:50.845785 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 09:51:50.845785 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 480def5d-9bba-44e0-a53c-65239a428e1c could not be found. Sep 16 09:51:50.845785 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:51:50.845785 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:51:50.845785 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:51:50.845785 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:51:50.845785 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:51:50.845785 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:51:50.845785 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 09:51:50.845785 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 09:51:50.845785 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 480def5d-9bba-44e0-a53c-65239a428e1c could not be found. Sep 16 09:51:50.845785 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:51:50.853331 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-4949644b-ee37-4591-b37f-43ccbac97c10 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Returning 404 to user: Instance 480def5d-9bba-44e0-a53c-65239a428e1c could not be found. {{(pid=127671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 09:51:50.853331 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-4949644b-ee37-4591-b37f-43ccbac97c10 tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] 10.222.0.73 "DELETE /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c" status: 404 len: 111 microversion: 2.1 time: 0.034757 Sep 16 09:51:50.853331 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 90/178] 10.222.0.73 () {58 vars in 1239 bytes} [Fri Sep 16 09:51:50 2022] DELETE /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 09:51:50.862159 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-2d94c30b-ae92-42bd-897e-de2a5dbdcd1a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1522 microversion: 2.1 time: 0.169485 Sep 16 09:51:50.873863 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-4ecf7a7d-b775-4d4c-a642-30947c30e5bf tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:50.874694 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-4ecf7a7d-b775-4d4c-a642-30947c30e5bf tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] [instance: 480def5d-9bba-44e0-a53c-65239a428e1c] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:50.877967 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 89/179] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:50 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:50.882515 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4ecf7a7d-b775-4d4c-a642-30947c30e5bf tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:50.883186 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4ecf7a7d-b775-4d4c-a642-30947c30e5bf tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:50.883629 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4ecf7a7d-b775-4d4c-a642-30947c30e5bf tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:50.884347 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4ecf7a7d-b775-4d4c-a642-30947c30e5bf tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:50.884807 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4ecf7a7d-b775-4d4c-a642-30947c30e5bf tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:50.885235 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4ecf7a7d-b775-4d4c-a642-30947c30e5bf tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:50.901395 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.wsgi [None req-4ecf7a7d-b775-4d4c-a642-30947c30e5bf tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] HTTP exception thrown: Instance 480def5d-9bba-44e0-a53c-65239a428e1c could not be found. Sep 16 09:51:50.903242 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-4ecf7a7d-b775-4d4c-a642-30947c30e5bf tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Request method failure captured: Sep 16 09:51:50.903242 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: request: GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c HTTP/1.1 Sep 16 09:51:50.903242 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept: application/json Sep 16 09:51:50.903242 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept-Encoding: identity Sep 16 09:51:50.903242 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Connection: close Sep 16 09:51:50.903242 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Length: 0 Sep 16 09:51:50.903242 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Type: application/json Sep 16 09:51:50.903242 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Host: 10.222.0.73 Sep 16 09:51:50.903242 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Openstack-System-Scope: None Sep 16 09:51:50.903242 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: User-Agent: python-urllib3/1.26.12 Sep 16 09:51:50.903242 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Auth-Token: gAAAAABjJEbziUY_PEDWhlG7Wdp21ZdlyprwmLStOq95ekImroPr5YvsViebJKEOVL5bDDXZyltmnqVxChliCyt4PErvklluhNzDYzbp66O3m0DXwY2_nFZ_IAEqaqX0lQv9F39yfc65rVuGC7pSx73lr08MWZ0dcJz_3cdwz6YlW9zjZ80CNg8 Sep 16 09:51:50.903242 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Id: None Sep 16 09:51:50.903242 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Name: None Sep 16 09:51:50.903242 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Identity-Status: Confirmed Sep 16 09:51:50.903242 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Is-Admin-Project: True Sep 16 09:51:50.903242 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Id: default Sep 16 09:51:50.903242 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Name: Default Sep 16 09:51:50.903242 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Id: cca830d4d9384e99b6f499a457776de4 Sep 16 09:51:50.903242 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Name: tempest-DeleteServersTestJSON-1133296427 Sep 16 09:51:50.903242 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Role: reader,member Sep 16 09:51:50.903242 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Roles: reader,member Sep 16 09:51:50.904698 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/cca830d4d9384e99b6f499a457776de4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_cca830d4d9384e99b6f499a457776de4", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/cca830d4d9384e99b6f499a457776de4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/cca830d4d9384e99b6f499a457776de4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 09:51:50.904698 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant: tempest-DeleteServersTestJSON-1133296427 Sep 16 09:51:50.904698 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Id: cca830d4d9384e99b6f499a457776de4 Sep 16 09:51:50.904698 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Name: tempest-DeleteServersTestJSON-1133296427 Sep 16 09:51:50.904698 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User: tempest-DeleteServersTestJSON-1133296427-project Sep 16 09:51:50.904698 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Id: default Sep 16 09:51:50.904698 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Name: Default Sep 16 09:51:50.904698 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Id: 807093ae546a4e42a21c2755f49abc59 Sep 16 09:51:50.904698 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Name: tempest-DeleteServersTestJSON-1133296427-project Sep 16 09:51:50.904698 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: method: > Sep 16 09:51:50.904698 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: exception: Instance 480def5d-9bba-44e0-a53c-65239a428e1c could not be found. Sep 16 09:51:50.904698 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: action_args: {'id': '480def5d-9bba-44e0-a53c-65239a428e1c'} Sep 16 09:51:50.905593 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 09:51:50.905593 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:51:50.905593 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 09:51:50.905593 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 09:51:50.905593 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 09:51:50.905593 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 09:51:50.905593 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 09:51:50.905593 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 09:51:50.905593 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 09:51:50.905593 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 09:51:50.905593 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 480def5d-9bba-44e0-a53c-65239a428e1c could not be found. Sep 16 09:51:50.905593 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:51:50.905593 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:51:50.905593 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:51:50.905593 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:51:50.905593 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:51:50.905593 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:51:50.905593 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 09:51:50.905593 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 09:51:50.905593 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 09:51:50.906961 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:51:50.906961 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 09:51:50.906961 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 09:51:50.906961 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 09:51:50.906961 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 09:51:50.906961 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 09:51:50.906961 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 09:51:50.906961 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 480def5d-9bba-44e0-a53c-65239a428e1c could not be found. Sep 16 09:51:50.906961 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:51:50.906961 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:51:50.906961 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:51:50.906961 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:51:50.906961 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:51:50.906961 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:51:50.906961 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 09:51:50.906961 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 09:51:50.906961 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 480def5d-9bba-44e0-a53c-65239a428e1c could not be found. Sep 16 09:51:50.906961 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:51:50.908121 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-4ecf7a7d-b775-4d4c-a642-30947c30e5bf tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] Returning 404 to user: Instance 480def5d-9bba-44e0-a53c-65239a428e1c could not be found. {{(pid=127671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 09:51:50.908121 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-4ecf7a7d-b775-4d4c-a642-30947c30e5bf tempest-DeleteServersTestJSON-1133296427 tempest-DeleteServersTestJSON-1133296427-project] 10.222.0.73 "GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c" status: 404 len: 111 microversion: 2.1 time: 0.047865 Sep 16 09:51:50.908121 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 91/180] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:50 2022] GET /compute/v2.1/servers/480def5d-9bba-44e0-a53c-65239a428e1c => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 09:51:51.886151 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-27afc99b-21c3-4c91-b30e-256cd4933eba tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:51.886663 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-27afc99b-21c3-4c91-b30e-256cd4933eba tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:51.896714 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-27afc99b-21c3-4c91-b30e-256cd4933eba tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:51.896714 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-27afc99b-21c3-4c91-b30e-256cd4933eba tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:51.896714 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-27afc99b-21c3-4c91-b30e-256cd4933eba tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:51.896714 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-27afc99b-21c3-4c91-b30e-256cd4933eba tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:51.897045 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-27afc99b-21c3-4c91-b30e-256cd4933eba tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:51.897045 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-27afc99b-21c3-4c91-b30e-256cd4933eba tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:52.147250 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-27afc99b-21c3-4c91-b30e-256cd4933eba tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:52.178769 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-27afc99b-21c3-4c91-b30e-256cd4933eba tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1522 microversion: 2.1 time: 0.291169 Sep 16 09:51:52.180092 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 90/181] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:51 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:53.206074 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-eaa6442f-7b7d-4bf1-908a-d7a5f983e655 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:53.207408 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-eaa6442f-7b7d-4bf1-908a-d7a5f983e655 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:53.225116 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-eaa6442f-7b7d-4bf1-908a-d7a5f983e655 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:53.227669 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-eaa6442f-7b7d-4bf1-908a-d7a5f983e655 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:53.228151 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-eaa6442f-7b7d-4bf1-908a-d7a5f983e655 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:53.228908 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-eaa6442f-7b7d-4bf1-908a-d7a5f983e655 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:53.231349 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-eaa6442f-7b7d-4bf1-908a-d7a5f983e655 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:53.235629 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-eaa6442f-7b7d-4bf1-908a-d7a5f983e655 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:53.571907 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-eaa6442f-7b7d-4bf1-908a-d7a5f983e655 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:53.586779 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-eaa6442f-7b7d-4bf1-908a-d7a5f983e655 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1522 microversion: 2.1 time: 0.386714 Sep 16 09:51:53.598219 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 92/182] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:53 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1522 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:54.611492 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d8488b51-f344-460f-9588-70e79df655da tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:54.612112 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-d8488b51-f344-460f-9588-70e79df655da tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:54.625627 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d8488b51-f344-460f-9588-70e79df655da tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:54.626858 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d8488b51-f344-460f-9588-70e79df655da tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:54.629460 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d8488b51-f344-460f-9588-70e79df655da tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:54.630271 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d8488b51-f344-460f-9588-70e79df655da tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:54.630741 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d8488b51-f344-460f-9588-70e79df655da tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:54.631171 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d8488b51-f344-460f-9588-70e79df655da tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:54.910775 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-d8488b51-f344-460f-9588-70e79df655da tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:54.924810 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-d8488b51-f344-460f-9588-70e79df655da tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1522 microversion: 2.1 time: 0.314829 Sep 16 09:51:54.928259 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 91/183] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:54 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1522 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:55.958810 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-d94db087-e079-4910-9a3d-1bfa4135c061 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:55.959444 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-d94db087-e079-4910-9a3d-1bfa4135c061 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:55.966057 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d94db087-e079-4910-9a3d-1bfa4135c061 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:55.966533 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d94db087-e079-4910-9a3d-1bfa4135c061 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:55.966962 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d94db087-e079-4910-9a3d-1bfa4135c061 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:55.967652 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d94db087-e079-4910-9a3d-1bfa4135c061 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:55.968178 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d94db087-e079-4910-9a3d-1bfa4135c061 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:55.968506 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d94db087-e079-4910-9a3d-1bfa4135c061 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:56.112473 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-d94db087-e079-4910-9a3d-1bfa4135c061 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:56.121106 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-d94db087-e079-4910-9a3d-1bfa4135c061 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1522 microversion: 2.1 time: 0.166749 Sep 16 09:51:56.122544 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 93/184] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:55 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:57.144800 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-e9b7bcef-af42-483f-9ccc-c6b91a6dceb4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:57.150137 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-e9b7bcef-af42-483f-9ccc-c6b91a6dceb4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:57.151867 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e9b7bcef-af42-483f-9ccc-c6b91a6dceb4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:57.152363 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e9b7bcef-af42-483f-9ccc-c6b91a6dceb4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:57.152902 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e9b7bcef-af42-483f-9ccc-c6b91a6dceb4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:57.153642 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e9b7bcef-af42-483f-9ccc-c6b91a6dceb4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:57.154106 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e9b7bcef-af42-483f-9ccc-c6b91a6dceb4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:57.154536 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e9b7bcef-af42-483f-9ccc-c6b91a6dceb4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:57.357623 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-e9b7bcef-af42-483f-9ccc-c6b91a6dceb4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:57.366258 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-e9b7bcef-af42-483f-9ccc-c6b91a6dceb4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1522 microversion: 2.1 time: 0.225780 Sep 16 09:51:57.366766 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 92/185] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:57 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:58.398692 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-2fe974de-93f9-4e15-9293-1a7969d5ae13 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:58.398692 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-2fe974de-93f9-4e15-9293-1a7969d5ae13 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:58.402515 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2fe974de-93f9-4e15-9293-1a7969d5ae13 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:58.404066 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2fe974de-93f9-4e15-9293-1a7969d5ae13 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:58.404595 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2fe974de-93f9-4e15-9293-1a7969d5ae13 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:58.405657 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2fe974de-93f9-4e15-9293-1a7969d5ae13 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:58.406185 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2fe974de-93f9-4e15-9293-1a7969d5ae13 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:58.406693 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2fe974de-93f9-4e15-9293-1a7969d5ae13 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:58.644689 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-2fe974de-93f9-4e15-9293-1a7969d5ae13 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:51:58.663543 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-2fe974de-93f9-4e15-9293-1a7969d5ae13 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1522 microversion: 2.1 time: 0.274637 Sep 16 09:51:58.663543 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 94/186] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:58 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:51:59.684426 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-fc1d2ac1-8c61-4836-b88b-2f1460f1f9b9 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:51:59.684955 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-fc1d2ac1-8c61-4836-b88b-2f1460f1f9b9 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:51:59.691813 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fc1d2ac1-8c61-4836-b88b-2f1460f1f9b9 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:59.692552 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fc1d2ac1-8c61-4836-b88b-2f1460f1f9b9 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:59.692998 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fc1d2ac1-8c61-4836-b88b-2f1460f1f9b9 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:51:59.693778 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fc1d2ac1-8c61-4836-b88b-2f1460f1f9b9 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:51:59.694240 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fc1d2ac1-8c61-4836-b88b-2f1460f1f9b9 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:51:59.694667 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fc1d2ac1-8c61-4836-b88b-2f1460f1f9b9 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:00.094351 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-fc1d2ac1-8c61-4836-b88b-2f1460f1f9b9 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:00.102546 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-fc1d2ac1-8c61-4836-b88b-2f1460f1f9b9 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1522 microversion: 2.1 time: 0.422040 Sep 16 09:52:00.110127 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 93/187] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:51:59 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1522 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:52:01.128402 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-a99be24a-b799-49c2-bcee-b0f7a40d3c86 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:01.129035 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-a99be24a-b799-49c2-bcee-b0f7a40d3c86 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:01.135911 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a99be24a-b799-49c2-bcee-b0f7a40d3c86 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:01.136410 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a99be24a-b799-49c2-bcee-b0f7a40d3c86 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:01.138703 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a99be24a-b799-49c2-bcee-b0f7a40d3c86 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:01.138703 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a99be24a-b799-49c2-bcee-b0f7a40d3c86 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:01.138703 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a99be24a-b799-49c2-bcee-b0f7a40d3c86 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:01.139039 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a99be24a-b799-49c2-bcee-b0f7a40d3c86 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:01.304004 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-a99be24a-b799-49c2-bcee-b0f7a40d3c86 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:01.317126 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-a99be24a-b799-49c2-bcee-b0f7a40d3c86 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1522 microversion: 2.1 time: 0.193043 Sep 16 09:52:01.318189 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 95/188] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:01 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:52:02.340743 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-f631ce95-c4d6-4565-ae15-e8e5f85311a2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:02.342325 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-f631ce95-c4d6-4565-ae15-e8e5f85311a2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:02.344335 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_api:SELECT=42 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:52:02.350436 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f631ce95-c4d6-4565-ae15-e8e5f85311a2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:02.351136 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f631ce95-c4d6-4565-ae15-e8e5f85311a2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:02.351736 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f631ce95-c4d6-4565-ae15-e8e5f85311a2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:02.352836 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f631ce95-c4d6-4565-ae15-e8e5f85311a2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:02.353300 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f631ce95-c4d6-4565-ae15-e8e5f85311a2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:02.353771 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f631ce95-c4d6-4565-ae15-e8e5f85311a2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:02.497712 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f631ce95-c4d6-4565-ae15-e8e5f85311a2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:02.506837 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-f631ce95-c4d6-4565-ae15-e8e5f85311a2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1522 microversion: 2.1 time: 0.170166 Sep 16 09:52:02.507636 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 94/189] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:02 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:52:03.530800 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-a06b1752-00c0-4a78-8cab-98447fc28cb4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:03.531416 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-a06b1752-00c0-4a78-8cab-98447fc28cb4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:03.539177 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a06b1752-00c0-4a78-8cab-98447fc28cb4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:03.539663 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a06b1752-00c0-4a78-8cab-98447fc28cb4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:03.540105 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a06b1752-00c0-4a78-8cab-98447fc28cb4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:03.540802 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a06b1752-00c0-4a78-8cab-98447fc28cb4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:03.541265 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a06b1752-00c0-4a78-8cab-98447fc28cb4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:03.541736 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a06b1752-00c0-4a78-8cab-98447fc28cb4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:03.671587 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-a06b1752-00c0-4a78-8cab-98447fc28cb4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:03.675319 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:52:03.679831 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-a06b1752-00c0-4a78-8cab-98447fc28cb4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1522 microversion: 2.1 time: 0.152955 Sep 16 09:52:03.680405 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 96/190] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:03 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:52:04.703231 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-f7aa949d-ec4f-44e4-92c2-4ae5fe81177e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:04.703954 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-f7aa949d-ec4f-44e4-92c2-4ae5fe81177e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:04.711509 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f7aa949d-ec4f-44e4-92c2-4ae5fe81177e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:04.712005 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f7aa949d-ec4f-44e4-92c2-4ae5fe81177e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:04.712449 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f7aa949d-ec4f-44e4-92c2-4ae5fe81177e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:04.713192 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f7aa949d-ec4f-44e4-92c2-4ae5fe81177e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:04.713681 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f7aa949d-ec4f-44e4-92c2-4ae5fe81177e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:04.714117 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f7aa949d-ec4f-44e4-92c2-4ae5fe81177e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:04.865509 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f7aa949d-ec4f-44e4-92c2-4ae5fe81177e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:04.873808 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-f7aa949d-ec4f-44e4-92c2-4ae5fe81177e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1522 microversion: 2.1 time: 0.174453 Sep 16 09:52:04.874333 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 95/191] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:04 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:52:05.898723 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-161397e1-2436-4165-bb03-52726bccaf3e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:05.899469 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-161397e1-2436-4165-bb03-52726bccaf3e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:05.906144 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-161397e1-2436-4165-bb03-52726bccaf3e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:05.911903 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-161397e1-2436-4165-bb03-52726bccaf3e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:05.911903 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-161397e1-2436-4165-bb03-52726bccaf3e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:05.911903 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-161397e1-2436-4165-bb03-52726bccaf3e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:05.911903 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-161397e1-2436-4165-bb03-52726bccaf3e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:05.912451 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-161397e1-2436-4165-bb03-52726bccaf3e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:06.046970 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-161397e1-2436-4165-bb03-52726bccaf3e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:06.055297 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-161397e1-2436-4165-bb03-52726bccaf3e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1522 microversion: 2.1 time: 0.162092 Sep 16 09:52:06.055868 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 97/192] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:05 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:52:07.079646 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-2f56e26a-d25d-4d1e-b691-08e6489052bf tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:07.080294 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-2f56e26a-d25d-4d1e-b691-08e6489052bf tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:07.086333 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2f56e26a-d25d-4d1e-b691-08e6489052bf tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:07.086907 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2f56e26a-d25d-4d1e-b691-08e6489052bf tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:07.087265 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2f56e26a-d25d-4d1e-b691-08e6489052bf tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:07.087960 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2f56e26a-d25d-4d1e-b691-08e6489052bf tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:07.088427 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2f56e26a-d25d-4d1e-b691-08e6489052bf tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:07.088908 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2f56e26a-d25d-4d1e-b691-08e6489052bf tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:07.220851 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-2f56e26a-d25d-4d1e-b691-08e6489052bf tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:07.229388 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-2f56e26a-d25d-4d1e-b691-08e6489052bf tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1522 microversion: 2.1 time: 0.153934 Sep 16 09:52:07.229992 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 96/193] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:07 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:52:08.253530 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-500af227-3106-4953-b6c5-14e14fbe721a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:08.254184 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-500af227-3106-4953-b6c5-14e14fbe721a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:08.261695 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-500af227-3106-4953-b6c5-14e14fbe721a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:08.262192 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-500af227-3106-4953-b6c5-14e14fbe721a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:08.262634 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-500af227-3106-4953-b6c5-14e14fbe721a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:08.263400 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-500af227-3106-4953-b6c5-14e14fbe721a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:08.263859 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-500af227-3106-4953-b6c5-14e14fbe721a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:08.264289 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-500af227-3106-4953-b6c5-14e14fbe721a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:08.395755 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-500af227-3106-4953-b6c5-14e14fbe721a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:08.403739 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-500af227-3106-4953-b6c5-14e14fbe721a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1522 microversion: 2.1 time: 0.155375 Sep 16 09:52:08.404526 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 98/194] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:08 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:52:09.427200 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-67654324-7859-4082-a973-cf34ae14b67e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:09.427806 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-67654324-7859-4082-a973-cf34ae14b67e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:09.433738 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-67654324-7859-4082-a973-cf34ae14b67e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:09.434224 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-67654324-7859-4082-a973-cf34ae14b67e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:09.434658 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-67654324-7859-4082-a973-cf34ae14b67e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:09.435365 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-67654324-7859-4082-a973-cf34ae14b67e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:09.435814 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-67654324-7859-4082-a973-cf34ae14b67e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:09.436232 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-67654324-7859-4082-a973-cf34ae14b67e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:09.569272 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-67654324-7859-4082-a973-cf34ae14b67e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:09.577078 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-67654324-7859-4082-a973-cf34ae14b67e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1522 microversion: 2.1 time: 0.154436 Sep 16 09:52:09.577690 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 97/195] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:09 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:52:10.600749 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-b4d88aca-01e5-403b-90af-89633b113d77 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:10.601583 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-b4d88aca-01e5-403b-90af-89633b113d77 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:10.608466 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b4d88aca-01e5-403b-90af-89633b113d77 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:10.608961 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b4d88aca-01e5-403b-90af-89633b113d77 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:10.609408 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b4d88aca-01e5-403b-90af-89633b113d77 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:10.610147 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b4d88aca-01e5-403b-90af-89633b113d77 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:10.610612 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b4d88aca-01e5-403b-90af-89633b113d77 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:10.611053 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b4d88aca-01e5-403b-90af-89633b113d77 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:10.742959 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-b4d88aca-01e5-403b-90af-89633b113d77 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:10.750686 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-b4d88aca-01e5-403b-90af-89633b113d77 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1522 microversion: 2.1 time: 0.154170 Sep 16 09:52:10.751228 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 99/196] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:10 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:52:11.775882 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-0676d6d4-3c74-4120-9af2-0a463169447d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:11.776609 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-0676d6d4-3c74-4120-9af2-0a463169447d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:11.783921 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0676d6d4-3c74-4120-9af2-0a463169447d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:11.784479 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0676d6d4-3c74-4120-9af2-0a463169447d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:11.784921 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0676d6d4-3c74-4120-9af2-0a463169447d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:11.785665 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0676d6d4-3c74-4120-9af2-0a463169447d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:11.786147 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0676d6d4-3c74-4120-9af2-0a463169447d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:11.808690 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0676d6d4-3c74-4120-9af2-0a463169447d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:11.936437 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-0676d6d4-3c74-4120-9af2-0a463169447d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:11.945306 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-0676d6d4-3c74-4120-9af2-0a463169447d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1522 microversion: 2.1 time: 0.173577 Sep 16 09:52:11.945934 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 98/197] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:11 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:52:12.968195 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-8d63f8b2-0fa0-4e4e-b352-5d52f3582a17 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:12.968799 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-8d63f8b2-0fa0-4e4e-b352-5d52f3582a17 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:12.971493 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:52:12.975909 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8d63f8b2-0fa0-4e4e-b352-5d52f3582a17 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:12.976373 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8d63f8b2-0fa0-4e4e-b352-5d52f3582a17 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:12.976801 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8d63f8b2-0fa0-4e4e-b352-5d52f3582a17 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:12.977503 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8d63f8b2-0fa0-4e4e-b352-5d52f3582a17 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:12.977978 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8d63f8b2-0fa0-4e4e-b352-5d52f3582a17 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:12.978399 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8d63f8b2-0fa0-4e4e-b352-5d52f3582a17 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:13.337894 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-8d63f8b2-0fa0-4e4e-b352-5d52f3582a17 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:13.346836 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-8d63f8b2-0fa0-4e4e-b352-5d52f3582a17 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1522 microversion: 2.1 time: 0.381444 Sep 16 09:52:13.346836 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 100/198] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:12 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1522 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:52:14.370533 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-68ab2825-7abd-4cf8-a0cc-eb53e8294c8e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:14.371214 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-68ab2825-7abd-4cf8-a0cc-eb53e8294c8e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:14.378182 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-68ab2825-7abd-4cf8-a0cc-eb53e8294c8e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:14.378715 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-68ab2825-7abd-4cf8-a0cc-eb53e8294c8e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:14.379102 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-68ab2825-7abd-4cf8-a0cc-eb53e8294c8e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:14.379810 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-68ab2825-7abd-4cf8-a0cc-eb53e8294c8e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:14.380272 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-68ab2825-7abd-4cf8-a0cc-eb53e8294c8e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:14.380789 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-68ab2825-7abd-4cf8-a0cc-eb53e8294c8e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:14.538363 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-68ab2825-7abd-4cf8-a0cc-eb53e8294c8e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:14.546569 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-68ab2825-7abd-4cf8-a0cc-eb53e8294c8e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1522 microversion: 2.1 time: 0.179897 Sep 16 09:52:14.547279 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 99/199] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:14 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:52:15.573576 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-d8b77a77-9d63-4187-a33e-ea58a908a79f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:15.574224 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-d8b77a77-9d63-4187-a33e-ea58a908a79f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:15.581908 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d8b77a77-9d63-4187-a33e-ea58a908a79f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:15.582410 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d8b77a77-9d63-4187-a33e-ea58a908a79f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:15.582876 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d8b77a77-9d63-4187-a33e-ea58a908a79f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:15.583573 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d8b77a77-9d63-4187-a33e-ea58a908a79f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:15.584051 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d8b77a77-9d63-4187-a33e-ea58a908a79f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:15.584483 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d8b77a77-9d63-4187-a33e-ea58a908a79f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:15.718740 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-d8b77a77-9d63-4187-a33e-ea58a908a79f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:15.727082 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-d8b77a77-9d63-4187-a33e-ea58a908a79f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1522 microversion: 2.1 time: 0.157350 Sep 16 09:52:15.727664 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 101/200] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:15 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:52:16.750024 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-b7dfded6-6848-4e00-8d0e-53a8b2a98b21 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:16.750616 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-b7dfded6-6848-4e00-8d0e-53a8b2a98b21 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:16.757072 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b7dfded6-6848-4e00-8d0e-53a8b2a98b21 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:16.757573 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b7dfded6-6848-4e00-8d0e-53a8b2a98b21 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:16.758011 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b7dfded6-6848-4e00-8d0e-53a8b2a98b21 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:16.758715 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b7dfded6-6848-4e00-8d0e-53a8b2a98b21 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:16.759162 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b7dfded6-6848-4e00-8d0e-53a8b2a98b21 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:16.760188 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b7dfded6-6848-4e00-8d0e-53a8b2a98b21 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:16.897133 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-b7dfded6-6848-4e00-8d0e-53a8b2a98b21 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:16.905042 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-b7dfded6-6848-4e00-8d0e-53a8b2a98b21 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1522 microversion: 2.1 time: 0.158917 Sep 16 09:52:16.906038 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 100/201] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:16 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:52:17.928336 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-f8507737-f4bf-468a-bd9b-34202bf8879c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:17.928967 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-f8507737-f4bf-468a-bd9b-34202bf8879c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:17.935456 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f8507737-f4bf-468a-bd9b-34202bf8879c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:17.935929 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f8507737-f4bf-468a-bd9b-34202bf8879c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:17.936358 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f8507737-f4bf-468a-bd9b-34202bf8879c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:17.937038 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f8507737-f4bf-468a-bd9b-34202bf8879c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:17.937491 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f8507737-f4bf-468a-bd9b-34202bf8879c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:17.937934 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f8507737-f4bf-468a-bd9b-34202bf8879c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:18.075026 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-f8507737-f4bf-468a-bd9b-34202bf8879c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:18.083262 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-f8507737-f4bf-468a-bd9b-34202bf8879c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1522 microversion: 2.1 time: 0.158778 Sep 16 09:52:18.083834 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 102/202] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:17 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:52:19.106042 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-a1173345-c875-44c2-b723-e7caae9475f8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:19.106641 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-a1173345-c875-44c2-b723-e7caae9475f8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:19.114640 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a1173345-c875-44c2-b723-e7caae9475f8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:19.115135 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a1173345-c875-44c2-b723-e7caae9475f8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:19.121349 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a1173345-c875-44c2-b723-e7caae9475f8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:19.121349 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a1173345-c875-44c2-b723-e7caae9475f8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:19.121349 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a1173345-c875-44c2-b723-e7caae9475f8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:19.121349 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a1173345-c875-44c2-b723-e7caae9475f8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:19.262762 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-a1173345-c875-44c2-b723-e7caae9475f8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:19.271518 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-a1173345-c875-44c2-b723-e7caae9475f8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1522 microversion: 2.1 time: 0.169196 Sep 16 09:52:19.272377 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 101/203] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:19 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:52:20.295695 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-4e3b0f0d-a8da-43be-b50c-82d8cfc40f75 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:20.296351 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-4e3b0f0d-a8da-43be-b50c-82d8cfc40f75 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:20.303435 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4e3b0f0d-a8da-43be-b50c-82d8cfc40f75 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:20.303935 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4e3b0f0d-a8da-43be-b50c-82d8cfc40f75 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:20.304383 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4e3b0f0d-a8da-43be-b50c-82d8cfc40f75 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:20.305188 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4e3b0f0d-a8da-43be-b50c-82d8cfc40f75 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:20.305681 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4e3b0f0d-a8da-43be-b50c-82d8cfc40f75 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:20.306114 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4e3b0f0d-a8da-43be-b50c-82d8cfc40f75 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:20.443126 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-4e3b0f0d-a8da-43be-b50c-82d8cfc40f75 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:20.452116 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-4e3b0f0d-a8da-43be-b50c-82d8cfc40f75 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1522 microversion: 2.1 time: 0.160444 Sep 16 09:52:20.452918 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 103/204] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:20 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:52:21.484210 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-83425d52-2358-482e-9047-d90acfbb1004 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:21.484854 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-83425d52-2358-482e-9047-d90acfbb1004 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:21.492489 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-83425d52-2358-482e-9047-d90acfbb1004 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:21.492967 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-83425d52-2358-482e-9047-d90acfbb1004 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:21.493465 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-83425d52-2358-482e-9047-d90acfbb1004 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:21.494167 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-83425d52-2358-482e-9047-d90acfbb1004 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:21.494775 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-83425d52-2358-482e-9047-d90acfbb1004 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:21.495358 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-83425d52-2358-482e-9047-d90acfbb1004 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:21.501070 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=79 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:52:21.632424 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-83425d52-2358-482e-9047-d90acfbb1004 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:21.642934 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-83425d52-2358-482e-9047-d90acfbb1004 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1522 microversion: 2.1 time: 0.162091 Sep 16 09:52:21.658622 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 102/205] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:21 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:52:22.670439 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-13dff0ff-cd21-4be9-86a5-66eb8c1b3c42 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:22.671178 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-13dff0ff-cd21-4be9-86a5-66eb8c1b3c42 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:22.679020 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-13dff0ff-cd21-4be9-86a5-66eb8c1b3c42 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:22.679600 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-13dff0ff-cd21-4be9-86a5-66eb8c1b3c42 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:22.680043 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-13dff0ff-cd21-4be9-86a5-66eb8c1b3c42 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:22.680759 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-13dff0ff-cd21-4be9-86a5-66eb8c1b3c42 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:22.681222 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-13dff0ff-cd21-4be9-86a5-66eb8c1b3c42 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:22.681681 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-13dff0ff-cd21-4be9-86a5-66eb8c1b3c42 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:22.828090 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-13dff0ff-cd21-4be9-86a5-66eb8c1b3c42 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:22.838259 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-13dff0ff-cd21-4be9-86a5-66eb8c1b3c42 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1522 microversion: 2.1 time: 0.173139 Sep 16 09:52:22.839781 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 104/206] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:22 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:52:23.023544 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-a3382ff7-80fc-46ac-b0ee-97282bc10c53 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:23.024078 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-a3382ff7-80fc-46ac-b0ee-97282bc10c53 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:23.030246 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a3382ff7-80fc-46ac-b0ee-97282bc10c53 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:23.030742 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a3382ff7-80fc-46ac-b0ee-97282bc10c53 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:23.031182 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a3382ff7-80fc-46ac-b0ee-97282bc10c53 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:23.032076 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a3382ff7-80fc-46ac-b0ee-97282bc10c53 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:23.032542 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a3382ff7-80fc-46ac-b0ee-97282bc10c53 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:23.032974 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a3382ff7-80fc-46ac-b0ee-97282bc10c53 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:23.057099 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-a3382ff7-80fc-46ac-b0ee-97282bc10c53 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de/ips" status: 200 len: 151 microversion: 2.20 time: 0.037727 Sep 16 09:52:23.057700 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 103/207] 10.222.0.73 () {60 vars in 1289 bytes} [Fri Sep 16 09:52:23 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 09:52:23.862714 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-5c4bcb7a-0939-4995-b0ee-b57968892f84 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:23.864489 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-5c4bcb7a-0939-4995-b0ee-b57968892f84 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:23.872712 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5c4bcb7a-0939-4995-b0ee-b57968892f84 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:23.873211 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5c4bcb7a-0939-4995-b0ee-b57968892f84 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:23.873720 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5c4bcb7a-0939-4995-b0ee-b57968892f84 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:23.874656 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5c4bcb7a-0939-4995-b0ee-b57968892f84 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:23.875597 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5c4bcb7a-0939-4995-b0ee-b57968892f84 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:23.876406 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5c4bcb7a-0939-4995-b0ee-b57968892f84 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:24.059587 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-5c4bcb7a-0939-4995-b0ee-b57968892f84 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:24.069358 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-5c4bcb7a-0939-4995-b0ee-b57968892f84 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1522 microversion: 2.1 time: 0.211198 Sep 16 09:52:24.070710 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 105/208] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:23 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:52:25.093508 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-c769a15c-192a-42ae-804c-41da5b9e2608 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:25.094146 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-c769a15c-192a-42ae-804c-41da5b9e2608 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:25.100638 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c769a15c-192a-42ae-804c-41da5b9e2608 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:25.101126 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c769a15c-192a-42ae-804c-41da5b9e2608 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:25.101593 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c769a15c-192a-42ae-804c-41da5b9e2608 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:25.102541 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c769a15c-192a-42ae-804c-41da5b9e2608 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:25.102751 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c769a15c-192a-42ae-804c-41da5b9e2608 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:25.103172 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c769a15c-192a-42ae-804c-41da5b9e2608 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:25.246921 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c769a15c-192a-42ae-804c-41da5b9e2608 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:25.256154 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-c769a15c-192a-42ae-804c-41da5b9e2608 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1522 microversion: 2.1 time: 0.166452 Sep 16 09:52:25.256736 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 104/209] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:25 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:52:26.238331 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-41503448-3e64-435e-ae63-b48fc0dd72db tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:52:26.239113 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-41503448-3e64-435e-ae63-b48fc0dd72db tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:26.246118 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-41503448-3e64-435e-ae63-b48fc0dd72db tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:26.246599 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-41503448-3e64-435e-ae63-b48fc0dd72db tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:26.247034 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-41503448-3e64-435e-ae63-b48fc0dd72db tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:26.247963 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-41503448-3e64-435e-ae63-b48fc0dd72db tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:26.248410 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-41503448-3e64-435e-ae63-b48fc0dd72db tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:26.248836 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-41503448-3e64-435e-ae63-b48fc0dd72db tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:26.274389 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.objects.instance [None req-41503448-3e64-435e-ae63-b48fc0dd72db tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lazy-loading 'flavor' on Instance uuid 88a0813e-ace7-48df-b688-533c8dbc81de {{(pid=127671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 09:52:26.279397 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d4e6d7a1-f027-4eb2-b41f-3f80641e0a81 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:26.280813 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-d4e6d7a1-f027-4eb2-b41f-3f80641e0a81 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:26.288360 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d4e6d7a1-f027-4eb2-b41f-3f80641e0a81 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:26.288898 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d4e6d7a1-f027-4eb2-b41f-3f80641e0a81 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:26.289342 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d4e6d7a1-f027-4eb2-b41f-3f80641e0a81 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:26.290707 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d4e6d7a1-f027-4eb2-b41f-3f80641e0a81 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:26.291357 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d4e6d7a1-f027-4eb2-b41f-3f80641e0a81 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:26.292018 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d4e6d7a1-f027-4eb2-b41f-3f80641e0a81 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:26.447710 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-d4e6d7a1-f027-4eb2-b41f-3f80641e0a81 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:26.456035 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-d4e6d7a1-f027-4eb2-b41f-3f80641e0a81 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1502 microversion: 2.1 time: 0.180491 Sep 16 09:52:26.456606 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 105/210] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:26 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1502 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:52:26.479728 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-dad4bbc2-908a-47ed-a05e-e37989f16d1a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:26.480468 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-dad4bbc2-908a-47ed-a05e-e37989f16d1a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: f634aa6d-e24c-48df-946f-3166fd76273a] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:26.487602 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dad4bbc2-908a-47ed-a05e-e37989f16d1a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:26.488141 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dad4bbc2-908a-47ed-a05e-e37989f16d1a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:26.488617 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dad4bbc2-908a-47ed-a05e-e37989f16d1a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:26.489595 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dad4bbc2-908a-47ed-a05e-e37989f16d1a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:26.490054 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dad4bbc2-908a-47ed-a05e-e37989f16d1a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:26.490478 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dad4bbc2-908a-47ed-a05e-e37989f16d1a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:26.637337 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-dad4bbc2-908a-47ed-a05e-e37989f16d1a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:26.648430 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-dad4bbc2-908a-47ed-a05e-e37989f16d1a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a" status: 200 len: 1516 microversion: 2.1 time: 0.172133 Sep 16 09:52:26.649666 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 106/211] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:26 2022] GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a => generated 1516 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:52:26.767054 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-41503448-3e64-435e-ae63-b48fc0dd72db tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "POST /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de/action" status: 202 len: 0 microversion: 2.20 time: 0.532519 Sep 16 09:52:26.771283 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 106/212] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Sep 16 09:52:26 2022] POST /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de/action => generated 0 bytes in 534 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 16 09:52:26.776869 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-387fcd7a-b0b4-4e15-8aa4-0b189f237fe7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:26.777483 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-387fcd7a-b0b4-4e15-8aa4-0b189f237fe7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:26.784423 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-387fcd7a-b0b4-4e15-8aa4-0b189f237fe7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:26.784910 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-387fcd7a-b0b4-4e15-8aa4-0b189f237fe7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:26.785349 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-387fcd7a-b0b4-4e15-8aa4-0b189f237fe7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:26.786292 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-387fcd7a-b0b4-4e15-8aa4-0b189f237fe7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:26.786759 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-387fcd7a-b0b4-4e15-8aa4-0b189f237fe7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:26.787189 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-387fcd7a-b0b4-4e15-8aa4-0b189f237fe7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:26.939601 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-387fcd7a-b0b4-4e15-8aa4-0b189f237fe7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:26.948249 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-387fcd7a-b0b4-4e15-8aa4-0b189f237fe7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:26.949706 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-387fcd7a-b0b4-4e15-8aa4-0b189f237fe7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:26.950856 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-387fcd7a-b0b4-4e15-8aa4-0b189f237fe7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1719 microversion: 2.20 time: 0.177931 Sep 16 09:52:26.951424 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 107/213] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:52:26 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1719 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:52:27.977595 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-d9e2f7bc-ff65-470b-a5ee-389dae2cfa2e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:27.978197 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-d9e2f7bc-ff65-470b-a5ee-389dae2cfa2e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:27.984481 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d9e2f7bc-ff65-470b-a5ee-389dae2cfa2e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:27.984973 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d9e2f7bc-ff65-470b-a5ee-389dae2cfa2e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:27.985420 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d9e2f7bc-ff65-470b-a5ee-389dae2cfa2e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:27.986192 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d9e2f7bc-ff65-470b-a5ee-389dae2cfa2e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:27.986654 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d9e2f7bc-ff65-470b-a5ee-389dae2cfa2e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:27.987719 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d9e2f7bc-ff65-470b-a5ee-389dae2cfa2e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:28.120945 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-d9e2f7bc-ff65-470b-a5ee-389dae2cfa2e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:28.129720 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-d9e2f7bc-ff65-470b-a5ee-389dae2cfa2e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:28.131239 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-d9e2f7bc-ff65-470b-a5ee-389dae2cfa2e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:28.136352 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-d9e2f7bc-ff65-470b-a5ee-389dae2cfa2e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1719 microversion: 2.20 time: 0.159814 Sep 16 09:52:28.136352 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 107/214] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:52:27 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1719 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:52:29.158397 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-842537d2-4f35-44c0-be83-76e9269b66f5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:29.159391 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-842537d2-4f35-44c0-be83-76e9269b66f5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:29.166193 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-842537d2-4f35-44c0-be83-76e9269b66f5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:29.166706 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-842537d2-4f35-44c0-be83-76e9269b66f5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:29.167149 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-842537d2-4f35-44c0-be83-76e9269b66f5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:29.167845 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-842537d2-4f35-44c0-be83-76e9269b66f5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:29.168308 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-842537d2-4f35-44c0-be83-76e9269b66f5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:29.168836 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-842537d2-4f35-44c0-be83-76e9269b66f5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:29.315681 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-842537d2-4f35-44c0-be83-76e9269b66f5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:29.323848 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-842537d2-4f35-44c0-be83-76e9269b66f5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:29.325298 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-842537d2-4f35-44c0-be83-76e9269b66f5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:29.326486 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-842537d2-4f35-44c0-be83-76e9269b66f5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1719 microversion: 2.20 time: 0.172538 Sep 16 09:52:29.327048 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 108/215] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:52:29 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1719 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:52:29.819822 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-b58c3f4a-7ec7-42a2-838d-b81d23ece110 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:29.820338 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-b58c3f4a-7ec7-42a2-838d-b81d23ece110 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: efec4ecb-65e7-4ca8-a29f-b87bc9ee1915] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:29.826905 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b58c3f4a-7ec7-42a2-838d-b81d23ece110 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:29.827396 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b58c3f4a-7ec7-42a2-838d-b81d23ece110 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:29.827874 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b58c3f4a-7ec7-42a2-838d-b81d23ece110 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:29.828574 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b58c3f4a-7ec7-42a2-838d-b81d23ece110 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:29.829032 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b58c3f4a-7ec7-42a2-838d-b81d23ece110 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:29.829466 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b58c3f4a-7ec7-42a2-838d-b81d23ece110 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:29.859527 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-b58c3f4a-7ec7-42a2-838d-b81d23ece110 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915/ips" status: 200 len: 149 microversion: 2.1 time: 0.043833 Sep 16 09:52:29.860106 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 108/216] 10.222.0.73 () {58 vars in 1248 bytes} [Fri Sep 16 09:52:29 2022] GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915/ips => generated 149 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:52:30.351101 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-b179d285-0fe9-4f2d-854a-fabd7398d933 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:30.351812 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-b179d285-0fe9-4f2d-854a-fabd7398d933 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:30.357791 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b179d285-0fe9-4f2d-854a-fabd7398d933 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:30.358288 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b179d285-0fe9-4f2d-854a-fabd7398d933 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:30.358726 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b179d285-0fe9-4f2d-854a-fabd7398d933 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:30.359422 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b179d285-0fe9-4f2d-854a-fabd7398d933 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:30.359901 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b179d285-0fe9-4f2d-854a-fabd7398d933 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:30.360329 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b179d285-0fe9-4f2d-854a-fabd7398d933 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:30.497880 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-b179d285-0fe9-4f2d-854a-fabd7398d933 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:30.508831 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-b179d285-0fe9-4f2d-854a-fabd7398d933 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:30.510287 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-b179d285-0fe9-4f2d-854a-fabd7398d933 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:30.511463 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-b179d285-0fe9-4f2d-854a-fabd7398d933 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1719 microversion: 2.20 time: 0.164347 Sep 16 09:52:30.512014 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 109/217] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:52:30 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1719 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:52:30.713503 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-30740900-0251-4f98-99a9-0487fb05d8c0 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:52:30.716158 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-30740900-0251-4f98-99a9-0487fb05d8c0 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: f634aa6d-e24c-48df-946f-3166fd76273a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:30.722036 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-30740900-0251-4f98-99a9-0487fb05d8c0 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:30.725059 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-30740900-0251-4f98-99a9-0487fb05d8c0 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:30.725059 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-30740900-0251-4f98-99a9-0487fb05d8c0 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:30.725059 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-30740900-0251-4f98-99a9-0487fb05d8c0 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:30.725059 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-30740900-0251-4f98-99a9-0487fb05d8c0 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:30.725484 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-30740900-0251-4f98-99a9-0487fb05d8c0 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:30.769344 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.objects.instance [None req-30740900-0251-4f98-99a9-0487fb05d8c0 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lazy-loading 'flavor' on Instance uuid f634aa6d-e24c-48df-946f-3166fd76273a {{(pid=127671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 09:52:31.096918 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:52:31.182459 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-30740900-0251-4f98-99a9-0487fb05d8c0 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "POST /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a/action" status: 200 len: 32 microversion: 2.1 time: 0.476746 Sep 16 09:52:31.183660 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 109/218] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Sep 16 09:52:30 2022] POST /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a/action => generated 32 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 09:52:31.193900 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-c3de79b8-cb5d-42c9-b5cb-94882fad5f3a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:31.194518 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-c3de79b8-cb5d-42c9-b5cb-94882fad5f3a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: f634aa6d-e24c-48df-946f-3166fd76273a] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:31.200609 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c3de79b8-cb5d-42c9-b5cb-94882fad5f3a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:31.201093 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c3de79b8-cb5d-42c9-b5cb-94882fad5f3a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:31.201524 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c3de79b8-cb5d-42c9-b5cb-94882fad5f3a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:31.202285 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c3de79b8-cb5d-42c9-b5cb-94882fad5f3a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:31.202743 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c3de79b8-cb5d-42c9-b5cb-94882fad5f3a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:31.203168 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c3de79b8-cb5d-42c9-b5cb-94882fad5f3a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:31.453228 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c3de79b8-cb5d-42c9-b5cb-94882fad5f3a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:31.467423 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-c3de79b8-cb5d-42c9-b5cb-94882fad5f3a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a" status: 200 len: 1522 microversion: 2.1 time: 0.277816 Sep 16 09:52:31.468524 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 110/219] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:31 2022] GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:52:31.539117 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-511570be-07f1-4d49-8940-53a2e868a352 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:31.539955 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-511570be-07f1-4d49-8940-53a2e868a352 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:31.562423 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-511570be-07f1-4d49-8940-53a2e868a352 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:31.563192 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-511570be-07f1-4d49-8940-53a2e868a352 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:31.564097 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-511570be-07f1-4d49-8940-53a2e868a352 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:31.565727 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-511570be-07f1-4d49-8940-53a2e868a352 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:31.566448 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-511570be-07f1-4d49-8940-53a2e868a352 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:31.567104 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-511570be-07f1-4d49-8940-53a2e868a352 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:31.750927 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-bb5a4480-002e-4a08-af52-03bfd5569286 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "671204a1-d033-4b52-a5b8-5fe366c8f42b"}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:52:31.757398 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-bb5a4480-002e-4a08-af52-03bfd5569286 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: efec4ecb-65e7-4ca8-a29f-b87bc9ee1915] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:31.764209 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bb5a4480-002e-4a08-af52-03bfd5569286 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:31.765194 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bb5a4480-002e-4a08-af52-03bfd5569286 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:31.765814 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bb5a4480-002e-4a08-af52-03bfd5569286 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:31.767338 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bb5a4480-002e-4a08-af52-03bfd5569286 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:31.768700 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bb5a4480-002e-4a08-af52-03bfd5569286 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:31.769293 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bb5a4480-002e-4a08-af52-03bfd5569286 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:31.801114 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-511570be-07f1-4d49-8940-53a2e868a352 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:31.813031 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-511570be-07f1-4d49-8940-53a2e868a352 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:31.814561 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-511570be-07f1-4d49-8940-53a2e868a352 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:31.817609 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-511570be-07f1-4d49-8940-53a2e868a352 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1719 microversion: 2.20 time: 0.282502 Sep 16 09:52:31.833672 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 110/220] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:52:31 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1719 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:52:32.491723 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-7571d30a-c4ad-4994-b8dc-80bf31e41ddf tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:32.492411 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-7571d30a-c4ad-4994-b8dc-80bf31e41ddf tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: f634aa6d-e24c-48df-946f-3166fd76273a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:32.498452 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7571d30a-c4ad-4994-b8dc-80bf31e41ddf tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:32.498929 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7571d30a-c4ad-4994-b8dc-80bf31e41ddf tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:32.499364 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7571d30a-c4ad-4994-b8dc-80bf31e41ddf tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:32.500047 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7571d30a-c4ad-4994-b8dc-80bf31e41ddf tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:32.500546 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7571d30a-c4ad-4994-b8dc-80bf31e41ddf tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:32.500962 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7571d30a-c4ad-4994-b8dc-80bf31e41ddf tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:32.646387 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-7571d30a-c4ad-4994-b8dc-80bf31e41ddf tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:32.654567 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-7571d30a-c4ad-4994-b8dc-80bf31e41ddf tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a" status: 200 len: 1522 microversion: 2.1 time: 0.168038 Sep 16 09:52:32.658970 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 111/221] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:32 2022] GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:52:32.846821 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-58d38fcb-9538-41b0-80b0-ecbb089c1dd9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:32.847651 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-58d38fcb-9538-41b0-80b0-ecbb089c1dd9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:32.854284 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-58d38fcb-9538-41b0-80b0-ecbb089c1dd9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:32.854774 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-58d38fcb-9538-41b0-80b0-ecbb089c1dd9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:32.855218 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-58d38fcb-9538-41b0-80b0-ecbb089c1dd9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:32.855918 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-58d38fcb-9538-41b0-80b0-ecbb089c1dd9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:32.856378 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-58d38fcb-9538-41b0-80b0-ecbb089c1dd9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:32.856804 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-58d38fcb-9538-41b0-80b0-ecbb089c1dd9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:33.004663 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-58d38fcb-9538-41b0-80b0-ecbb089c1dd9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:33.013256 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-58d38fcb-9538-41b0-80b0-ecbb089c1dd9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:33.015214 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-58d38fcb-9538-41b0-80b0-ecbb089c1dd9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:33.016667 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-58d38fcb-9538-41b0-80b0-ecbb089c1dd9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1719 microversion: 2.20 time: 0.174681 Sep 16 09:52:33.017415 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 112/222] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:52:32 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1719 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 09:52:33.058724 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-bb5a4480-002e-4a08-af52-03bfd5569286 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "POST /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.312448 Sep 16 09:52:33.064701 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 111/223] 10.222.0.73 () {60 vars in 1323 bytes} [Fri Sep 16 09:52:31 2022] POST /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915/os-volume_attachments => generated 194 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 09:52:33.679138 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-9b969a42-6fa4-4024-a155-61e65d3030fb tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:33.679791 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-9b969a42-6fa4-4024-a155-61e65d3030fb tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: f634aa6d-e24c-48df-946f-3166fd76273a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:33.685802 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9b969a42-6fa4-4024-a155-61e65d3030fb tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:33.686518 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9b969a42-6fa4-4024-a155-61e65d3030fb tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:33.686953 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9b969a42-6fa4-4024-a155-61e65d3030fb tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:33.687654 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9b969a42-6fa4-4024-a155-61e65d3030fb tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:33.688117 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9b969a42-6fa4-4024-a155-61e65d3030fb tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:33.688544 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9b969a42-6fa4-4024-a155-61e65d3030fb tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:33.833662 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-9b969a42-6fa4-4024-a155-61e65d3030fb tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:33.841700 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-9b969a42-6fa4-4024-a155-61e65d3030fb tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a" status: 200 len: 1522 microversion: 2.1 time: 0.166490 Sep 16 09:52:33.842255 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 113/224] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:33 2022] GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:52:34.045419 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-93b93bfd-54c1-4920-8935-0856d38ab4bc tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:34.046218 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-93b93bfd-54c1-4920-8935-0856d38ab4bc tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:34.053226 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-93b93bfd-54c1-4920-8935-0856d38ab4bc tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:34.053763 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-93b93bfd-54c1-4920-8935-0856d38ab4bc tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:34.054204 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-93b93bfd-54c1-4920-8935-0856d38ab4bc tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:34.054927 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-93b93bfd-54c1-4920-8935-0856d38ab4bc tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:34.055382 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-93b93bfd-54c1-4920-8935-0856d38ab4bc tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:34.055810 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-93b93bfd-54c1-4920-8935-0856d38ab4bc tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:34.202051 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-93b93bfd-54c1-4920-8935-0856d38ab4bc tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:34.210556 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-93b93bfd-54c1-4920-8935-0856d38ab4bc tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:34.212008 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-93b93bfd-54c1-4920-8935-0856d38ab4bc tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:34.213176 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-93b93bfd-54c1-4920-8935-0856d38ab4bc tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1719 microversion: 2.20 time: 0.172598 Sep 16 09:52:34.213771 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 112/225] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:52:34 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1719 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:52:34.866657 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-abc55a6b-2b7d-47ba-9bb7-9ba6ecc11ec2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:34.867271 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-abc55a6b-2b7d-47ba-9bb7-9ba6ecc11ec2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: f634aa6d-e24c-48df-946f-3166fd76273a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:34.873846 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-abc55a6b-2b7d-47ba-9bb7-9ba6ecc11ec2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:34.874340 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-abc55a6b-2b7d-47ba-9bb7-9ba6ecc11ec2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:34.874781 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-abc55a6b-2b7d-47ba-9bb7-9ba6ecc11ec2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:34.875480 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-abc55a6b-2b7d-47ba-9bb7-9ba6ecc11ec2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:34.875945 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-abc55a6b-2b7d-47ba-9bb7-9ba6ecc11ec2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:34.876378 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-abc55a6b-2b7d-47ba-9bb7-9ba6ecc11ec2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:35.010548 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-abc55a6b-2b7d-47ba-9bb7-9ba6ecc11ec2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:35.018665 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-abc55a6b-2b7d-47ba-9bb7-9ba6ecc11ec2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a" status: 200 len: 1522 microversion: 2.1 time: 0.157001 Sep 16 09:52:35.019244 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 114/226] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:34 2022] GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:52:35.239431 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-714f8cdd-5246-40e2-bc36-52662682f9de tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:35.240044 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-714f8cdd-5246-40e2-bc36-52662682f9de tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:35.242501 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_api:SELECT=38 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:52:35.247357 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-714f8cdd-5246-40e2-bc36-52662682f9de tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:35.247845 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-714f8cdd-5246-40e2-bc36-52662682f9de tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:35.248281 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-714f8cdd-5246-40e2-bc36-52662682f9de tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:35.249101 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-714f8cdd-5246-40e2-bc36-52662682f9de tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:35.249740 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-714f8cdd-5246-40e2-bc36-52662682f9de tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:35.250169 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-714f8cdd-5246-40e2-bc36-52662682f9de tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:35.386027 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-714f8cdd-5246-40e2-bc36-52662682f9de tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:35.395021 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-714f8cdd-5246-40e2-bc36-52662682f9de tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:35.396455 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-714f8cdd-5246-40e2-bc36-52662682f9de tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:35.397959 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-714f8cdd-5246-40e2-bc36-52662682f9de tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1719 microversion: 2.20 time: 0.162769 Sep 16 09:52:35.398513 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 113/227] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:52:35 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:52:36.042837 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-149c9fee-099b-49a0-8088-c63780ddeb34 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:36.043533 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-149c9fee-099b-49a0-8088-c63780ddeb34 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: f634aa6d-e24c-48df-946f-3166fd76273a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:36.063729 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-149c9fee-099b-49a0-8088-c63780ddeb34 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:36.064275 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-149c9fee-099b-49a0-8088-c63780ddeb34 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:36.064734 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-149c9fee-099b-49a0-8088-c63780ddeb34 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:36.065448 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-149c9fee-099b-49a0-8088-c63780ddeb34 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:36.067143 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-149c9fee-099b-49a0-8088-c63780ddeb34 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:36.067593 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-149c9fee-099b-49a0-8088-c63780ddeb34 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:36.206996 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-149c9fee-099b-49a0-8088-c63780ddeb34 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:36.222342 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-149c9fee-099b-49a0-8088-c63780ddeb34 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a" status: 200 len: 1522 microversion: 2.1 time: 0.177666 Sep 16 09:52:36.222342 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 115/228] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:36 2022] GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:52:36.424037 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-fcf2f64c-47c2-47b7-9b68-6da53bc6fa4e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:36.424812 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-fcf2f64c-47c2-47b7-9b68-6da53bc6fa4e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:36.431731 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fcf2f64c-47c2-47b7-9b68-6da53bc6fa4e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:36.432162 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fcf2f64c-47c2-47b7-9b68-6da53bc6fa4e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:36.432619 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fcf2f64c-47c2-47b7-9b68-6da53bc6fa4e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:36.433393 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fcf2f64c-47c2-47b7-9b68-6da53bc6fa4e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:36.433872 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fcf2f64c-47c2-47b7-9b68-6da53bc6fa4e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:36.434496 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fcf2f64c-47c2-47b7-9b68-6da53bc6fa4e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:36.580448 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-fcf2f64c-47c2-47b7-9b68-6da53bc6fa4e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:36.589429 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-fcf2f64c-47c2-47b7-9b68-6da53bc6fa4e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:36.590896 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-fcf2f64c-47c2-47b7-9b68-6da53bc6fa4e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:36.592083 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-fcf2f64c-47c2-47b7-9b68-6da53bc6fa4e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1719 microversion: 2.20 time: 0.172193 Sep 16 09:52:36.592633 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 114/229] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:52:36 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1719 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:52:37.241920 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-5c6f3ad8-06f4-4647-87d5-f874ed38d582 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:37.242558 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-5c6f3ad8-06f4-4647-87d5-f874ed38d582 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: f634aa6d-e24c-48df-946f-3166fd76273a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:37.249175 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5c6f3ad8-06f4-4647-87d5-f874ed38d582 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:37.249769 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5c6f3ad8-06f4-4647-87d5-f874ed38d582 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:37.250245 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5c6f3ad8-06f4-4647-87d5-f874ed38d582 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:37.250950 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5c6f3ad8-06f4-4647-87d5-f874ed38d582 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:37.251410 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5c6f3ad8-06f4-4647-87d5-f874ed38d582 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:37.251841 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5c6f3ad8-06f4-4647-87d5-f874ed38d582 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:37.439533 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-5c6f3ad8-06f4-4647-87d5-f874ed38d582 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:37.452982 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-5c6f3ad8-06f4-4647-87d5-f874ed38d582 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a" status: 200 len: 1522 microversion: 2.1 time: 0.215806 Sep 16 09:52:37.453942 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 116/230] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:37 2022] GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:52:37.619557 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-79e6cf7c-84bb-43bd-b181-98ca484f15b3 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:37.621487 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-79e6cf7c-84bb-43bd-b181-98ca484f15b3 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:37.633406 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-79e6cf7c-84bb-43bd-b181-98ca484f15b3 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:37.634530 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-79e6cf7c-84bb-43bd-b181-98ca484f15b3 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:37.635967 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-79e6cf7c-84bb-43bd-b181-98ca484f15b3 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:37.636923 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-79e6cf7c-84bb-43bd-b181-98ca484f15b3 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:37.638006 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-79e6cf7c-84bb-43bd-b181-98ca484f15b3 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:37.638662 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-79e6cf7c-84bb-43bd-b181-98ca484f15b3 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:37.808298 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-79e6cf7c-84bb-43bd-b181-98ca484f15b3 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:37.818084 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-79e6cf7c-84bb-43bd-b181-98ca484f15b3 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:37.820075 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-79e6cf7c-84bb-43bd-b181-98ca484f15b3 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:37.825099 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-79e6cf7c-84bb-43bd-b181-98ca484f15b3 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1719 microversion: 2.20 time: 0.206394 Sep 16 09:52:37.825099 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 115/231] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:52:37 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1719 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:52:38.482516 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-c5a7987e-712e-4949-95cb-172bb3c7221f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:38.483127 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-c5a7987e-712e-4949-95cb-172bb3c7221f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: f634aa6d-e24c-48df-946f-3166fd76273a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:38.490755 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c5a7987e-712e-4949-95cb-172bb3c7221f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:38.491278 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c5a7987e-712e-4949-95cb-172bb3c7221f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:38.491725 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c5a7987e-712e-4949-95cb-172bb3c7221f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:38.492435 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c5a7987e-712e-4949-95cb-172bb3c7221f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:38.493065 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c5a7987e-712e-4949-95cb-172bb3c7221f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:38.493493 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c5a7987e-712e-4949-95cb-172bb3c7221f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:38.646204 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-c5a7987e-712e-4949-95cb-172bb3c7221f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:38.654027 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-c5a7987e-712e-4949-95cb-172bb3c7221f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a" status: 200 len: 1522 microversion: 2.1 time: 0.175370 Sep 16 09:52:38.654613 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 117/232] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:38 2022] GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:52:38.849126 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-393b69aa-ddf3-4153-946a-2c833f03a575 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:38.849853 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-393b69aa-ddf3-4153-946a-2c833f03a575 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:38.856967 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-393b69aa-ddf3-4153-946a-2c833f03a575 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:38.857462 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-393b69aa-ddf3-4153-946a-2c833f03a575 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:38.857924 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-393b69aa-ddf3-4153-946a-2c833f03a575 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:38.858629 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-393b69aa-ddf3-4153-946a-2c833f03a575 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:38.859402 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-393b69aa-ddf3-4153-946a-2c833f03a575 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:38.859529 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-393b69aa-ddf3-4153-946a-2c833f03a575 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:39.007514 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-393b69aa-ddf3-4153-946a-2c833f03a575 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:39.016338 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-393b69aa-ddf3-4153-946a-2c833f03a575 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:39.020151 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-393b69aa-ddf3-4153-946a-2c833f03a575 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:39.020151 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-393b69aa-ddf3-4153-946a-2c833f03a575 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1719 microversion: 2.20 time: 0.174298 Sep 16 09:52:39.020619 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 116/233] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:52:38 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1719 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:52:39.677293 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-356c3b32-e12f-4f05-9b4b-be616ea33cef tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:39.677983 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-356c3b32-e12f-4f05-9b4b-be616ea33cef tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: f634aa6d-e24c-48df-946f-3166fd76273a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:39.684667 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-356c3b32-e12f-4f05-9b4b-be616ea33cef tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:39.685167 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-356c3b32-e12f-4f05-9b4b-be616ea33cef tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:39.685638 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-356c3b32-e12f-4f05-9b4b-be616ea33cef tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:39.694872 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-356c3b32-e12f-4f05-9b4b-be616ea33cef tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:39.694872 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-356c3b32-e12f-4f05-9b4b-be616ea33cef tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:39.694872 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-356c3b32-e12f-4f05-9b4b-be616ea33cef tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:39.852319 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-356c3b32-e12f-4f05-9b4b-be616ea33cef tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:39.860112 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-356c3b32-e12f-4f05-9b4b-be616ea33cef tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a" status: 200 len: 1522 microversion: 2.1 time: 0.187550 Sep 16 09:52:39.860692 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 118/234] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:39 2022] GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:52:40.045614 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-12224c77-0c07-473b-b54f-f125ed4191f0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:40.046294 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-12224c77-0c07-473b-b54f-f125ed4191f0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:40.052910 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-12224c77-0c07-473b-b54f-f125ed4191f0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:40.053419 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-12224c77-0c07-473b-b54f-f125ed4191f0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:40.053862 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-12224c77-0c07-473b-b54f-f125ed4191f0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:40.054557 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-12224c77-0c07-473b-b54f-f125ed4191f0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:40.055009 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-12224c77-0c07-473b-b54f-f125ed4191f0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:40.055434 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-12224c77-0c07-473b-b54f-f125ed4191f0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:40.203649 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-12224c77-0c07-473b-b54f-f125ed4191f0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:40.206685 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:52:40.213178 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-12224c77-0c07-473b-b54f-f125ed4191f0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:40.214648 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-12224c77-0c07-473b-b54f-f125ed4191f0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:40.215802 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-12224c77-0c07-473b-b54f-f125ed4191f0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1719 microversion: 2.20 time: 0.174178 Sep 16 09:52:40.216358 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 117/235] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:52:40 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1719 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 09:52:40.884553 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-c00bc5ef-411f-4ed4-9849-609c7b64da45 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:40.885292 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-c00bc5ef-411f-4ed4-9849-609c7b64da45 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: f634aa6d-e24c-48df-946f-3166fd76273a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:40.892476 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c00bc5ef-411f-4ed4-9849-609c7b64da45 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:40.893764 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c00bc5ef-411f-4ed4-9849-609c7b64da45 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:40.894356 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c00bc5ef-411f-4ed4-9849-609c7b64da45 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:40.894980 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c00bc5ef-411f-4ed4-9849-609c7b64da45 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:40.895449 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c00bc5ef-411f-4ed4-9849-609c7b64da45 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:40.895881 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c00bc5ef-411f-4ed4-9849-609c7b64da45 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:41.062374 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-c00bc5ef-411f-4ed4-9849-609c7b64da45 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:41.070853 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-c00bc5ef-411f-4ed4-9849-609c7b64da45 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a" status: 200 len: 1522 microversion: 2.1 time: 0.190323 Sep 16 09:52:41.071425 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 119/236] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:40 2022] GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:52:41.242992 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-e7610c2b-ac80-428a-87c1-e82a4af58403 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:41.244471 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-e7610c2b-ac80-428a-87c1-e82a4af58403 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:41.251966 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e7610c2b-ac80-428a-87c1-e82a4af58403 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:41.253135 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e7610c2b-ac80-428a-87c1-e82a4af58403 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:41.254258 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e7610c2b-ac80-428a-87c1-e82a4af58403 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:41.255331 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e7610c2b-ac80-428a-87c1-e82a4af58403 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:41.256067 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e7610c2b-ac80-428a-87c1-e82a4af58403 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:41.256496 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e7610c2b-ac80-428a-87c1-e82a4af58403 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:41.482260 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-e7610c2b-ac80-428a-87c1-e82a4af58403 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:41.493142 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-e7610c2b-ac80-428a-87c1-e82a4af58403 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:41.494844 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-e7610c2b-ac80-428a-87c1-e82a4af58403 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:41.496179 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-e7610c2b-ac80-428a-87c1-e82a4af58403 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1719 microversion: 2.20 time: 0.257515 Sep 16 09:52:41.497080 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 118/237] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:52:41 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1719 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:52:42.094837 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-a2094728-91ff-4582-8436-b3cff971d21a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:42.095514 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-a2094728-91ff-4582-8436-b3cff971d21a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: f634aa6d-e24c-48df-946f-3166fd76273a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:42.102699 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a2094728-91ff-4582-8436-b3cff971d21a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:42.103442 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a2094728-91ff-4582-8436-b3cff971d21a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:42.104058 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a2094728-91ff-4582-8436-b3cff971d21a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:42.104787 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a2094728-91ff-4582-8436-b3cff971d21a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:42.105249 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a2094728-91ff-4582-8436-b3cff971d21a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:42.105704 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a2094728-91ff-4582-8436-b3cff971d21a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:42.252584 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-a2094728-91ff-4582-8436-b3cff971d21a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:42.260814 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-a2094728-91ff-4582-8436-b3cff971d21a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a" status: 200 len: 1522 microversion: 2.1 time: 0.170057 Sep 16 09:52:42.261426 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 120/238] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:42 2022] GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:52:42.524893 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-93687f66-3a22-42d1-ab5c-36d93b7f6bfa tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:42.525575 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-93687f66-3a22-42d1-ab5c-36d93b7f6bfa tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:42.659728 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-93687f66-3a22-42d1-ab5c-36d93b7f6bfa tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:42.659728 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-93687f66-3a22-42d1-ab5c-36d93b7f6bfa tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:42.659728 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-93687f66-3a22-42d1-ab5c-36d93b7f6bfa tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:42.659728 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-93687f66-3a22-42d1-ab5c-36d93b7f6bfa tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:42.660731 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-93687f66-3a22-42d1-ab5c-36d93b7f6bfa tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:42.660731 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-93687f66-3a22-42d1-ab5c-36d93b7f6bfa tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:42.684610 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-93687f66-3a22-42d1-ab5c-36d93b7f6bfa tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:42.700716 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-93687f66-3a22-42d1-ab5c-36d93b7f6bfa tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:42.702591 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-93687f66-3a22-42d1-ab5c-36d93b7f6bfa tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:42.704008 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-93687f66-3a22-42d1-ab5c-36d93b7f6bfa tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1719 microversion: 2.20 time: 0.183131 Sep 16 09:52:42.705592 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 119/239] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:52:42 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1719 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:52:43.286630 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-12da71db-4fc3-440e-a1af-5622d2cd5b90 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:43.287207 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-12da71db-4fc3-440e-a1af-5622d2cd5b90 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: f634aa6d-e24c-48df-946f-3166fd76273a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:43.289820 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_api:SELECT=42 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:52:43.295178 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-12da71db-4fc3-440e-a1af-5622d2cd5b90 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:43.299566 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-12da71db-4fc3-440e-a1af-5622d2cd5b90 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:43.299566 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-12da71db-4fc3-440e-a1af-5622d2cd5b90 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:43.299566 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-12da71db-4fc3-440e-a1af-5622d2cd5b90 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:43.299566 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-12da71db-4fc3-440e-a1af-5622d2cd5b90 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:43.300072 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-12da71db-4fc3-440e-a1af-5622d2cd5b90 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:43.596407 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-12da71db-4fc3-440e-a1af-5622d2cd5b90 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:43.613313 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-12da71db-4fc3-440e-a1af-5622d2cd5b90 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a" status: 200 len: 1522 microversion: 2.1 time: 0.327899 Sep 16 09:52:43.613313 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 121/240] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:43 2022] GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a => generated 1522 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:52:43.721248 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-3b99a16b-229c-4d0b-a787-5ce0f242bc72 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1215413753", "imageRef": "30d28050-ec9d-4227-9bb0-5247430f6177", "flavorRef": "452", "networks": [{"uuid": "15e63dfc-22b7-48c1-94c3-7e5f623a1d1a"}]}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:52:43.739105 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-58371ea1-0ea4-4de9-a333-0cf8873642af tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:43.742009 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-58371ea1-0ea4-4de9-a333-0cf8873642af tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:43.750886 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-58371ea1-0ea4-4de9-a333-0cf8873642af tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:43.751949 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-58371ea1-0ea4-4de9-a333-0cf8873642af tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:43.753222 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-58371ea1-0ea4-4de9-a333-0cf8873642af tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:43.755053 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-58371ea1-0ea4-4de9-a333-0cf8873642af tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:43.755475 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-58371ea1-0ea4-4de9-a333-0cf8873642af tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:43.757804 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-58371ea1-0ea4-4de9-a333-0cf8873642af tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:43.798281 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.network.neutron [None req-3b99a16b-229c-4d0b-a787-5ce0f242bc72 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] validate_networks() for [('15e63dfc-22b7-48c1-94c3-7e5f623a1d1a', None, None, None, None, None)] {{(pid=127670) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 09:52:43.920220 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-58371ea1-0ea4-4de9-a333-0cf8873642af tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:43.933753 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-58371ea1-0ea4-4de9-a333-0cf8873642af tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:43.935223 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-58371ea1-0ea4-4de9-a333-0cf8873642af tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:43.937045 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-58371ea1-0ea4-4de9-a333-0cf8873642af tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1719 microversion: 2.20 time: 0.207560 Sep 16 09:52:43.937729 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 122/241] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:52:43 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1719 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:52:44.221591 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-3b99a16b-229c-4d0b-a787-5ce0f242bc72 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Flavor limits 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 09:52:44.222475 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-3b99a16b-229c-4d0b-a787-5ce0f242bc72 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Image limits 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 09:52:44.223037 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-3b99a16b-229c-4d0b-a787-5ce0f242bc72 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Flavor pref 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 09:52:44.223488 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-3b99a16b-229c-4d0b-a787-5ce0f242bc72 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Image pref 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 09:52:44.223911 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-3b99a16b-229c-4d0b-a787-5ce0f242bc72 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 09:52:44.233261 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3b99a16b-229c-4d0b-a787-5ce0f242bc72 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:44.233817 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3b99a16b-229c-4d0b-a787-5ce0f242bc72 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:44.234260 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3b99a16b-229c-4d0b-a787-5ce0f242bc72 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:44.235008 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3b99a16b-229c-4d0b-a787-5ce0f242bc72 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:44.235495 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3b99a16b-229c-4d0b-a787-5ce0f242bc72 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:44.235924 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3b99a16b-229c-4d0b-a787-5ce0f242bc72 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:44.254200 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-3b99a16b-229c-4d0b-a787-5ce0f242bc72 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Getting quotas for project 6e0c83ab03cd40d6a1ffcc3d5b369d64. Resources: {'instances', 'cores', 'ram'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 09:52:44.258588 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-3b99a16b-229c-4d0b-a787-5ce0f242bc72 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Getting quotas for user 08285b64824b40d384df767c993db55b and project 6e0c83ab03cd40d6a1ffcc3d5b369d64. Resources: {'instances', 'cores', 'ram'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 09:52:44.270692 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-3b99a16b-229c-4d0b-a787-5ce0f242bc72 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Going to run 1 instances... {{(pid=127670) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 09:52:44.272999 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-3b99a16b-229c-4d0b-a787-5ce0f242bc72 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: cbfe8395-a1da-4ff2-8951-0ffeaf568bae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='30d28050-ec9d-4227-9bb0-5247430f6177',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 09:52:44.386067 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-3b99a16b-229c-4d0b-a787-5ce0f242bc72 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.668679 Sep 16 09:52:44.386744 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 120/242] 10.222.0.73 () {60 vars in 1147 bytes} [Fri Sep 16 09:52:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 09:52:44.400630 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-14b473e5-63f9-4151-9d7c-38254641beb8 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:44.401827 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-14b473e5-63f9-4151-9d7c-38254641beb8 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: cbfe8395-a1da-4ff2-8951-0ffeaf568bae] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:44.468657 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-14b473e5-63f9-4151-9d7c-38254641beb8 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:44.477287 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-14b473e5-63f9-4151-9d7c-38254641beb8 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/cbfe8395-a1da-4ff2-8951-0ffeaf568bae" status: 200 len: 1214 microversion: 2.1 time: 0.081632 Sep 16 09:52:44.485673 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 123/243] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:44 2022] GET /compute/v2.1/servers/cbfe8395-a1da-4ff2-8951-0ffeaf568bae => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:52:44.637021 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-0d7fc809-1e5d-4054-9219-f48d3b5eac91 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:44.637565 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-0d7fc809-1e5d-4054-9219-f48d3b5eac91 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: f634aa6d-e24c-48df-946f-3166fd76273a] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:44.647042 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0d7fc809-1e5d-4054-9219-f48d3b5eac91 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:44.647527 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0d7fc809-1e5d-4054-9219-f48d3b5eac91 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:44.647962 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0d7fc809-1e5d-4054-9219-f48d3b5eac91 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:44.648656 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0d7fc809-1e5d-4054-9219-f48d3b5eac91 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:44.649176 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0d7fc809-1e5d-4054-9219-f48d3b5eac91 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:44.649643 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0d7fc809-1e5d-4054-9219-f48d3b5eac91 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:44.793744 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-0d7fc809-1e5d-4054-9219-f48d3b5eac91 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:44.804255 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-0d7fc809-1e5d-4054-9219-f48d3b5eac91 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a" status: 200 len: 1522 microversion: 2.1 time: 0.171419 Sep 16 09:52:44.805096 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 121/244] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:44 2022] GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:52:44.966021 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-e2ba1194-74ab-495c-8d96-efca8c878e47 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:44.967008 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-e2ba1194-74ab-495c-8d96-efca8c878e47 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:44.998085 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e2ba1194-74ab-495c-8d96-efca8c878e47 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:44.998085 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e2ba1194-74ab-495c-8d96-efca8c878e47 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:44.998085 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e2ba1194-74ab-495c-8d96-efca8c878e47 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:44.998085 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e2ba1194-74ab-495c-8d96-efca8c878e47 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:44.998425 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e2ba1194-74ab-495c-8d96-efca8c878e47 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:44.998425 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e2ba1194-74ab-495c-8d96-efca8c878e47 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:45.005072 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-e2395d12-d4bd-4808-bd03-8eaf5a1bd41a tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Action: 'create', calling method: .version_select at 0x7ffa6de07a60>, body: {"keypair": {"name": "tempest-keypair-558716720", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF97wl3Q8urYUuFWSO0PIkCxwTL2i033+YWOzQWcWRS4VX6F4FvaiZZAED/Ow7pO1eJbYJ0lcgBjcYxC7Asrq7msJR4Pjp/D3CNl6O9ZWEvH/d/B/cf5rdJoO5LRnjM6sQ=="}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:52:45.024487 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-e2395d12-d4bd-4808-bd03-8eaf5a1bd41a tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Getting quotas for project 75007587f92646f686881c2e1bfb7b2d. Resources: {'key_pairs'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 09:52:45.029308 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-e2395d12-d4bd-4808-bd03-8eaf5a1bd41a tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Getting quotas for user 7dca5726e89343828e25def6e6c274bb and project 75007587f92646f686881c2e1bfb7b2d. Resources: {'key_pairs'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 09:52:45.135091 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-e2ba1194-74ab-495c-8d96-efca8c878e47 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:45.144137 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-e2ba1194-74ab-495c-8d96-efca8c878e47 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:45.146099 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-e2ba1194-74ab-495c-8d96-efca8c878e47 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:45.147540 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-e2ba1194-74ab-495c-8d96-efca8c878e47 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1719 microversion: 2.20 time: 0.186638 Sep 16 09:52:45.148169 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 124/245] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:52:44 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1719 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:52:45.178513 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-e2395d12-d4bd-4808-bd03-8eaf5a1bd41a tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.178979 Sep 16 09:52:45.179128 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 122/246] 10.222.0.73 () {60 vars in 1159 bytes} [Fri Sep 16 09:52:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:52:45.508284 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-f58dcb94-f387-4f08-9c28-272bb3156208 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:45.508891 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-f58dcb94-f387-4f08-9c28-272bb3156208 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: cbfe8395-a1da-4ff2-8951-0ffeaf568bae] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:45.589200 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-f58dcb94-f387-4f08-9c28-272bb3156208 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:45.598353 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-f58dcb94-f387-4f08-9c28-272bb3156208 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/cbfe8395-a1da-4ff2-8951-0ffeaf568bae" status: 200 len: 1214 microversion: 2.1 time: 0.093793 Sep 16 09:52:45.599024 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 125/247] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:45 2022] GET /compute/v2.1/servers/cbfe8395-a1da-4ff2-8951-0ffeaf568bae => generated 1214 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:52:45.828477 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-1338c95d-2224-463c-872b-b4fe4081dde4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:45.829085 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-1338c95d-2224-463c-872b-b4fe4081dde4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: f634aa6d-e24c-48df-946f-3166fd76273a] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:45.836195 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1338c95d-2224-463c-872b-b4fe4081dde4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:45.836790 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1338c95d-2224-463c-872b-b4fe4081dde4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:45.837414 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1338c95d-2224-463c-872b-b4fe4081dde4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:45.838168 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1338c95d-2224-463c-872b-b4fe4081dde4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:45.838924 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1338c95d-2224-463c-872b-b4fe4081dde4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:45.839436 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1338c95d-2224-463c-872b-b4fe4081dde4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:45.985005 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-1338c95d-2224-463c-872b-b4fe4081dde4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:46.002874 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-1338c95d-2224-463c-872b-b4fe4081dde4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a" status: 200 len: 1522 microversion: 2.1 time: 0.170761 Sep 16 09:52:46.002874 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 123/248] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:45 2022] GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:52:46.175642 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-7b4ef015-403c-4755-bea8-4674bb690029 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:46.176211 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-7b4ef015-403c-4755-bea8-4674bb690029 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:46.183463 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7b4ef015-403c-4755-bea8-4674bb690029 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:46.183982 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7b4ef015-403c-4755-bea8-4674bb690029 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:46.184424 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7b4ef015-403c-4755-bea8-4674bb690029 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:46.185147 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7b4ef015-403c-4755-bea8-4674bb690029 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:46.185631 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7b4ef015-403c-4755-bea8-4674bb690029 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:46.186090 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7b4ef015-403c-4755-bea8-4674bb690029 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:46.329752 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-7b4ef015-403c-4755-bea8-4674bb690029 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:46.340693 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-7b4ef015-403c-4755-bea8-4674bb690029 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:46.342354 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-7b4ef015-403c-4755-bea8-4674bb690029 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:46.343544 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-7b4ef015-403c-4755-bea8-4674bb690029 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1719 microversion: 2.20 time: 0.172044 Sep 16 09:52:46.344104 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 126/249] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:52:46 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1719 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:52:46.621997 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-815ba8dc-b3a7-4fb4-a613-2efe688547ee tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:46.622593 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-815ba8dc-b3a7-4fb4-a613-2efe688547ee tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: cbfe8395-a1da-4ff2-8951-0ffeaf568bae] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:46.628797 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-815ba8dc-b3a7-4fb4-a613-2efe688547ee tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:46.629291 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-815ba8dc-b3a7-4fb4-a613-2efe688547ee tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:46.629761 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-815ba8dc-b3a7-4fb4-a613-2efe688547ee tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:46.630465 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-815ba8dc-b3a7-4fb4-a613-2efe688547ee tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:46.630923 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-815ba8dc-b3a7-4fb4-a613-2efe688547ee tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:46.631351 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-815ba8dc-b3a7-4fb4-a613-2efe688547ee tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:46.695352 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-815ba8dc-b3a7-4fb4-a613-2efe688547ee tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:46.703197 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-815ba8dc-b3a7-4fb4-a613-2efe688547ee tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/cbfe8395-a1da-4ff2-8951-0ffeaf568bae" status: 200 len: 1218 microversion: 2.1 time: 0.085249 Sep 16 09:52:46.703778 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 124/250] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:46 2022] GET /compute/v2.1/servers/cbfe8395-a1da-4ff2-8951-0ffeaf568bae => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:52:47.020192 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-fb490e62-a5c0-49f6-8435-0a8d15cecacd tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:47.020774 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-fb490e62-a5c0-49f6-8435-0a8d15cecacd tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: f634aa6d-e24c-48df-946f-3166fd76273a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:47.027129 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-fb490e62-a5c0-49f6-8435-0a8d15cecacd tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:47.027621 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-fb490e62-a5c0-49f6-8435-0a8d15cecacd tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:47.028061 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-fb490e62-a5c0-49f6-8435-0a8d15cecacd tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:47.028797 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-fb490e62-a5c0-49f6-8435-0a8d15cecacd tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:47.029260 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-fb490e62-a5c0-49f6-8435-0a8d15cecacd tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:47.029715 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-fb490e62-a5c0-49f6-8435-0a8d15cecacd tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:47.176750 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-fb490e62-a5c0-49f6-8435-0a8d15cecacd tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:47.185382 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-fb490e62-a5c0-49f6-8435-0a8d15cecacd tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a" status: 200 len: 1522 microversion: 2.1 time: 0.169637 Sep 16 09:52:47.186007 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 127/251] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:47 2022] GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:52:47.372807 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-f30fcc69-ac9d-4b68-82d0-e1c69e4137bb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:47.374088 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-f30fcc69-ac9d-4b68-82d0-e1c69e4137bb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:47.381005 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f30fcc69-ac9d-4b68-82d0-e1c69e4137bb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:47.382350 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f30fcc69-ac9d-4b68-82d0-e1c69e4137bb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:47.382350 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f30fcc69-ac9d-4b68-82d0-e1c69e4137bb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:47.382745 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f30fcc69-ac9d-4b68-82d0-e1c69e4137bb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:47.383204 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f30fcc69-ac9d-4b68-82d0-e1c69e4137bb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:47.383864 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f30fcc69-ac9d-4b68-82d0-e1c69e4137bb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:47.596586 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f30fcc69-ac9d-4b68-82d0-e1c69e4137bb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:47.606171 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f30fcc69-ac9d-4b68-82d0-e1c69e4137bb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:47.608697 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f30fcc69-ac9d-4b68-82d0-e1c69e4137bb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:47.610326 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-f30fcc69-ac9d-4b68-82d0-e1c69e4137bb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1719 microversion: 2.20 time: 0.242709 Sep 16 09:52:47.611715 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 125/252] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:52:47 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1719 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:52:47.726625 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-55eb5b5e-5825-47b2-b517-319f3d379568 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:47.727241 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-55eb5b5e-5825-47b2-b517-319f3d379568 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: cbfe8395-a1da-4ff2-8951-0ffeaf568bae] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:47.733499 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-55eb5b5e-5825-47b2-b517-319f3d379568 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:47.734025 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-55eb5b5e-5825-47b2-b517-319f3d379568 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:47.734476 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-55eb5b5e-5825-47b2-b517-319f3d379568 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:47.735190 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-55eb5b5e-5825-47b2-b517-319f3d379568 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:47.736081 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-55eb5b5e-5825-47b2-b517-319f3d379568 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:47.736324 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-55eb5b5e-5825-47b2-b517-319f3d379568 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:47.766850 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell1:SELECT=100 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:52:47.810232 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-55eb5b5e-5825-47b2-b517-319f3d379568 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:47.818904 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-55eb5b5e-5825-47b2-b517-319f3d379568 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/cbfe8395-a1da-4ff2-8951-0ffeaf568bae" status: 200 len: 1218 microversion: 2.1 time: 0.096189 Sep 16 09:52:47.819476 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 128/253] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:47 2022] GET /compute/v2.1/servers/cbfe8395-a1da-4ff2-8951-0ffeaf568bae => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:52:48.046242 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-863a2289-6b86-4eea-a651-c40a7195f23c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1591474735", "imageRef": "30d28050-ec9d-4227-9bb0-5247430f6177", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b92b7908-54f3-4444-8e37-e6621fa07310"}], "security_groups": [{"name": "tempest-securitygroup--1795327329"}], "key_name": "tempest-keypair-558716720", "user_data": "}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:52:48.213161 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-ef9b2042-1566-454c-a9c3-5852f58bf0ea tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:48.217381 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-ef9b2042-1566-454c-a9c3-5852f58bf0ea tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: f634aa6d-e24c-48df-946f-3166fd76273a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:48.224118 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ef9b2042-1566-454c-a9c3-5852f58bf0ea tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:48.224819 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ef9b2042-1566-454c-a9c3-5852f58bf0ea tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:48.225361 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ef9b2042-1566-454c-a9c3-5852f58bf0ea tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:48.226248 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ef9b2042-1566-454c-a9c3-5852f58bf0ea tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:48.226796 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ef9b2042-1566-454c-a9c3-5852f58bf0ea tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:48.227328 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ef9b2042-1566-454c-a9c3-5852f58bf0ea tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:48.280268 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.network.neutron [None req-863a2289-6b86-4eea-a651-c40a7195f23c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] validate_networks() for [('b92b7908-54f3-4444-8e37-e6621fa07310', None, None, None, None, None)] {{(pid=127670) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 09:52:48.367786 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-ef9b2042-1566-454c-a9c3-5852f58bf0ea tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:48.375524 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-ef9b2042-1566-454c-a9c3-5852f58bf0ea tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a" status: 200 len: 1522 microversion: 2.1 time: 0.167734 Sep 16 09:52:48.376144 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 129/254] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:48 2022] GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:52:48.638540 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-b7f3d209-63b3-4346-b76f-0c95ef618b9a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:48.639430 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-b7f3d209-63b3-4346-b76f-0c95ef618b9a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:48.646751 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b7f3d209-63b3-4346-b76f-0c95ef618b9a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:48.647463 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b7f3d209-63b3-4346-b76f-0c95ef618b9a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:48.647915 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b7f3d209-63b3-4346-b76f-0c95ef618b9a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:48.648694 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b7f3d209-63b3-4346-b76f-0c95ef618b9a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:48.649154 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b7f3d209-63b3-4346-b76f-0c95ef618b9a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:48.649623 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b7f3d209-63b3-4346-b76f-0c95ef618b9a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:48.682580 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-863a2289-6b86-4eea-a651-c40a7195f23c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Flavor limits 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 09:52:48.683320 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-863a2289-6b86-4eea-a651-c40a7195f23c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Image limits 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 09:52:48.684130 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-863a2289-6b86-4eea-a651-c40a7195f23c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Flavor pref 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 09:52:48.686018 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-863a2289-6b86-4eea-a651-c40a7195f23c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Image pref 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 09:52:48.686524 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-863a2289-6b86-4eea-a651-c40a7195f23c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 09:52:48.697651 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-863a2289-6b86-4eea-a651-c40a7195f23c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:48.698152 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-863a2289-6b86-4eea-a651-c40a7195f23c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:48.701030 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-863a2289-6b86-4eea-a651-c40a7195f23c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:48.701030 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-863a2289-6b86-4eea-a651-c40a7195f23c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:48.701030 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-863a2289-6b86-4eea-a651-c40a7195f23c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:48.701030 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-863a2289-6b86-4eea-a651-c40a7195f23c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:48.720849 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-863a2289-6b86-4eea-a651-c40a7195f23c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Getting quotas for project 75007587f92646f686881c2e1bfb7b2d. Resources: {'instances', 'cores', 'ram'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 09:52:48.724080 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-863a2289-6b86-4eea-a651-c40a7195f23c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Getting quotas for user 7dca5726e89343828e25def6e6c274bb and project 75007587f92646f686881c2e1bfb7b2d. Resources: {'instances', 'cores', 'ram'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 09:52:48.735884 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-863a2289-6b86-4eea-a651-c40a7195f23c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Going to run 1 instances... {{(pid=127670) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 09:52:48.739233 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-863a2289-6b86-4eea-a651-c40a7195f23c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 33e0e447-38a7-474d-ae32-1941ee3260c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='30d28050-ec9d-4227-9bb0-5247430f6177',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 09:52:48.797294 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-b7f3d209-63b3-4346-b76f-0c95ef618b9a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:48.807253 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-b7f3d209-63b3-4346-b76f-0c95ef618b9a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:48.808694 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-b7f3d209-63b3-4346-b76f-0c95ef618b9a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:48.810399 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-b7f3d209-63b3-4346-b76f-0c95ef618b9a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1719 microversion: 2.20 time: 0.175663 Sep 16 09:52:48.821867 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 130/255] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:52:48 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1719 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 09:52:48.842346 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-09c81ff6-534c-45e8-b155-478709d53052 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:48.842949 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-09c81ff6-534c-45e8-b155-478709d53052 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: cbfe8395-a1da-4ff2-8951-0ffeaf568bae] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:48.849263 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-09c81ff6-534c-45e8-b155-478709d53052 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:48.849788 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-09c81ff6-534c-45e8-b155-478709d53052 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:48.850230 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-09c81ff6-534c-45e8-b155-478709d53052 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:48.851554 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-09c81ff6-534c-45e8-b155-478709d53052 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:48.851554 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-09c81ff6-534c-45e8-b155-478709d53052 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:48.851891 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-09c81ff6-534c-45e8-b155-478709d53052 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:48.904873 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-863a2289-6b86-4eea-a651-c40a7195f23c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.863225 Sep 16 09:52:48.905518 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 126/256] 10.222.0.73 () {60 vars in 1147 bytes} [Fri Sep 16 09:52:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 09:52:48.917749 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-c4087ad8-5b9b-406a-b795-7ebd939ef9ec tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:48.918370 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-c4087ad8-5b9b-406a-b795-7ebd939ef9ec tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 33e0e447-38a7-474d-ae32-1941ee3260c6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:48.918659 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-09c81ff6-534c-45e8-b155-478709d53052 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:48.933275 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-09c81ff6-534c-45e8-b155-478709d53052 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/cbfe8395-a1da-4ff2-8951-0ffeaf568bae" status: 200 len: 1218 microversion: 2.1 time: 0.094956 Sep 16 09:52:48.934242 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 131/257] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:48 2022] GET /compute/v2.1/servers/cbfe8395-a1da-4ff2-8951-0ffeaf568bae => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:52:48.973902 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c4087ad8-5b9b-406a-b795-7ebd939ef9ec tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:48.981243 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-c4087ad8-5b9b-406a-b795-7ebd939ef9ec tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6" status: 200 len: 1241 microversion: 2.1 time: 0.067322 Sep 16 09:52:48.982015 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 127/258] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:48 2022] GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6 => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:52:49.398565 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-f3e60753-974e-40e0-b19b-567da0c0436d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:49.399174 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-f3e60753-974e-40e0-b19b-567da0c0436d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: f634aa6d-e24c-48df-946f-3166fd76273a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:49.405678 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f3e60753-974e-40e0-b19b-567da0c0436d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:49.407965 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f3e60753-974e-40e0-b19b-567da0c0436d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:49.407965 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f3e60753-974e-40e0-b19b-567da0c0436d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:49.407965 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f3e60753-974e-40e0-b19b-567da0c0436d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:49.407965 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f3e60753-974e-40e0-b19b-567da0c0436d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:49.408924 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f3e60753-974e-40e0-b19b-567da0c0436d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:49.549249 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-f3e60753-974e-40e0-b19b-567da0c0436d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:49.556962 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-f3e60753-974e-40e0-b19b-567da0c0436d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a" status: 200 len: 1522 microversion: 2.1 time: 0.162362 Sep 16 09:52:49.557528 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 132/259] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:49 2022] GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:52:49.838713 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-21bae887-22ae-4112-88c6-d6813ed91cea tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:49.839489 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-21bae887-22ae-4112-88c6-d6813ed91cea tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:49.849947 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-21bae887-22ae-4112-88c6-d6813ed91cea tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:49.850334 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-21bae887-22ae-4112-88c6-d6813ed91cea tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:49.850900 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-21bae887-22ae-4112-88c6-d6813ed91cea tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:49.851510 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-21bae887-22ae-4112-88c6-d6813ed91cea tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:49.851978 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-21bae887-22ae-4112-88c6-d6813ed91cea tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:49.852415 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-21bae887-22ae-4112-88c6-d6813ed91cea tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:49.957942 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-99dab08d-d71f-448e-9195-4021c316cdd9 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:49.958516 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-99dab08d-d71f-448e-9195-4021c316cdd9 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: cbfe8395-a1da-4ff2-8951-0ffeaf568bae] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:49.964549 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-99dab08d-d71f-448e-9195-4021c316cdd9 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:49.965052 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-99dab08d-d71f-448e-9195-4021c316cdd9 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:49.965489 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-99dab08d-d71f-448e-9195-4021c316cdd9 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:49.966242 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-99dab08d-d71f-448e-9195-4021c316cdd9 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:49.966705 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-99dab08d-d71f-448e-9195-4021c316cdd9 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:49.967140 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-99dab08d-d71f-448e-9195-4021c316cdd9 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:49.997813 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-21bae887-22ae-4112-88c6-d6813ed91cea tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:50.008285 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-21bae887-22ae-4112-88c6-d6813ed91cea tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:50.009923 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-21bae887-22ae-4112-88c6-d6813ed91cea tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:50.011147 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-21bae887-22ae-4112-88c6-d6813ed91cea tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1719 microversion: 2.20 time: 0.176987 Sep 16 09:52:50.011716 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 128/260] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:52:49 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1719 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:52:50.016463 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-e0c67013-a185-4648-905c-e12ea28ab36f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:50.017351 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-e0c67013-a185-4648-905c-e12ea28ab36f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 33e0e447-38a7-474d-ae32-1941ee3260c6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:50.025224 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e0c67013-a185-4648-905c-e12ea28ab36f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:50.030780 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e0c67013-a185-4648-905c-e12ea28ab36f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:50.030780 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e0c67013-a185-4648-905c-e12ea28ab36f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:50.030780 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e0c67013-a185-4648-905c-e12ea28ab36f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:50.030780 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e0c67013-a185-4648-905c-e12ea28ab36f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:50.031270 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e0c67013-a185-4648-905c-e12ea28ab36f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:50.050974 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-99dab08d-d71f-448e-9195-4021c316cdd9 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:50.065479 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-99dab08d-d71f-448e-9195-4021c316cdd9 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/cbfe8395-a1da-4ff2-8951-0ffeaf568bae" status: 200 len: 1210 microversion: 2.1 time: 0.111085 Sep 16 09:52:50.065479 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 133/261] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:49 2022] GET /compute/v2.1/servers/cbfe8395-a1da-4ff2-8951-0ffeaf568bae => generated 1210 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:52:50.103332 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-e0c67013-a185-4648-905c-e12ea28ab36f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:50.111093 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-e0c67013-a185-4648-905c-e12ea28ab36f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6" status: 200 len: 1245 microversion: 2.1 time: 0.098419 Sep 16 09:52:50.112199 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 129/262] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:50 2022] GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6 => generated 1245 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:52:50.583253 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-26519f34-cd58-4a77-b259-901c74733e11 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:50.583253 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-26519f34-cd58-4a77-b259-901c74733e11 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: f634aa6d-e24c-48df-946f-3166fd76273a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:50.588196 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-26519f34-cd58-4a77-b259-901c74733e11 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:50.588682 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-26519f34-cd58-4a77-b259-901c74733e11 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:50.589129 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-26519f34-cd58-4a77-b259-901c74733e11 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:50.589886 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-26519f34-cd58-4a77-b259-901c74733e11 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:50.590414 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-26519f34-cd58-4a77-b259-901c74733e11 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:50.590846 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-26519f34-cd58-4a77-b259-901c74733e11 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:50.730756 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-26519f34-cd58-4a77-b259-901c74733e11 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:50.739712 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-26519f34-cd58-4a77-b259-901c74733e11 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a" status: 200 len: 1522 microversion: 2.1 time: 0.163399 Sep 16 09:52:50.740296 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 134/263] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:50 2022] GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:52:51.037593 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-01f0e00e-5457-4c64-82bc-7439a82c4909 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:51.038362 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-01f0e00e-5457-4c64-82bc-7439a82c4909 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:51.044837 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-01f0e00e-5457-4c64-82bc-7439a82c4909 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:51.045324 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-01f0e00e-5457-4c64-82bc-7439a82c4909 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:51.045853 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-01f0e00e-5457-4c64-82bc-7439a82c4909 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:51.046579 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-01f0e00e-5457-4c64-82bc-7439a82c4909 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:51.047037 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-01f0e00e-5457-4c64-82bc-7439a82c4909 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:51.047465 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-01f0e00e-5457-4c64-82bc-7439a82c4909 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:51.087789 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-20264367-8c3a-4ca4-b310-d1d202e6825c tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:51.089215 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-20264367-8c3a-4ca4-b310-d1d202e6825c tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: cbfe8395-a1da-4ff2-8951-0ffeaf568bae] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:51.097215 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-20264367-8c3a-4ca4-b310-d1d202e6825c tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:51.098137 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-20264367-8c3a-4ca4-b310-d1d202e6825c tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:51.098670 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-20264367-8c3a-4ca4-b310-d1d202e6825c tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:51.099830 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-20264367-8c3a-4ca4-b310-d1d202e6825c tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:51.100294 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-20264367-8c3a-4ca4-b310-d1d202e6825c tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:51.100875 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-20264367-8c3a-4ca4-b310-d1d202e6825c tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:51.207804 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-20264367-8c3a-4ca4-b310-d1d202e6825c tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:51.210268 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-01f0e00e-5457-4c64-82bc-7439a82c4909 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:51.215813 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-20264367-8c3a-4ca4-b310-d1d202e6825c tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/cbfe8395-a1da-4ff2-8951-0ffeaf568bae" status: 200 len: 1274 microversion: 2.1 time: 0.131873 Sep 16 09:52:51.216884 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 135/264] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:51 2022] GET /compute/v2.1/servers/cbfe8395-a1da-4ff2-8951-0ffeaf568bae => generated 1274 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:52:51.221749 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-9b36c7dd-868b-482c-ae7f-be1179c82f04 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:51.222664 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-9b36c7dd-868b-482c-ae7f-be1179c82f04 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 33e0e447-38a7-474d-ae32-1941ee3260c6] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:51.228717 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9b36c7dd-868b-482c-ae7f-be1179c82f04 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:51.229387 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9b36c7dd-868b-482c-ae7f-be1179c82f04 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:51.234909 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9b36c7dd-868b-482c-ae7f-be1179c82f04 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:51.234909 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9b36c7dd-868b-482c-ae7f-be1179c82f04 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:51.234909 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9b36c7dd-868b-482c-ae7f-be1179c82f04 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:51.234909 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9b36c7dd-868b-482c-ae7f-be1179c82f04 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:51.235341 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-01f0e00e-5457-4c64-82bc-7439a82c4909 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:51.238497 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-01f0e00e-5457-4c64-82bc-7439a82c4909 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:51.239731 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-01f0e00e-5457-4c64-82bc-7439a82c4909 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1719 microversion: 2.20 time: 0.206899 Sep 16 09:52:51.240465 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 130/265] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:52:51 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1719 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:52:51.309575 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-9b36c7dd-868b-482c-ae7f-be1179c82f04 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:51.320298 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-9b36c7dd-868b-482c-ae7f-be1179c82f04 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6" status: 200 len: 1293 microversion: 2.1 time: 0.102211 Sep 16 09:52:51.325659 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 136/266] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:51 2022] GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6 => generated 1293 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:52:51.764651 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-ab7dc49e-7ffd-4a3e-8d1a-19686d7b7f8d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:51.765520 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-ab7dc49e-7ffd-4a3e-8d1a-19686d7b7f8d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: f634aa6d-e24c-48df-946f-3166fd76273a] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:51.772761 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ab7dc49e-7ffd-4a3e-8d1a-19686d7b7f8d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:51.773262 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ab7dc49e-7ffd-4a3e-8d1a-19686d7b7f8d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:51.776335 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ab7dc49e-7ffd-4a3e-8d1a-19686d7b7f8d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:51.776335 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ab7dc49e-7ffd-4a3e-8d1a-19686d7b7f8d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:51.776335 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ab7dc49e-7ffd-4a3e-8d1a-19686d7b7f8d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:51.776335 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ab7dc49e-7ffd-4a3e-8d1a-19686d7b7f8d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:51.929362 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-ab7dc49e-7ffd-4a3e-8d1a-19686d7b7f8d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:51.937868 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-ab7dc49e-7ffd-4a3e-8d1a-19686d7b7f8d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a" status: 200 len: 1522 microversion: 2.1 time: 0.177171 Sep 16 09:52:51.938455 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 131/267] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:51 2022] GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:52:52.250310 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-b0126158-cb07-4e97-a742-e1387d898ee4 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:52.252984 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-b0126158-cb07-4e97-a742-e1387d898ee4 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: cbfe8395-a1da-4ff2-8951-0ffeaf568bae] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:52.269628 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b0126158-cb07-4e97-a742-e1387d898ee4 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:52.270388 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b0126158-cb07-4e97-a742-e1387d898ee4 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:52.271482 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b0126158-cb07-4e97-a742-e1387d898ee4 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:52.274247 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b0126158-cb07-4e97-a742-e1387d898ee4 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:52.276632 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b0126158-cb07-4e97-a742-e1387d898ee4 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:52.277326 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-eea338bd-dab0-466a-a0a0-6cf97f4127e7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:52.278168 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-eea338bd-dab0-466a-a0a0-6cf97f4127e7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:52.279104 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b0126158-cb07-4e97-a742-e1387d898ee4 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:52.293367 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-eea338bd-dab0-466a-a0a0-6cf97f4127e7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:52.294189 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-eea338bd-dab0-466a-a0a0-6cf97f4127e7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:52.295976 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-eea338bd-dab0-466a-a0a0-6cf97f4127e7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:52.305802 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-eea338bd-dab0-466a-a0a0-6cf97f4127e7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:52.306649 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-eea338bd-dab0-466a-a0a0-6cf97f4127e7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:52.329379 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-eea338bd-dab0-466a-a0a0-6cf97f4127e7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:52.581714 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-b0126158-cb07-4e97-a742-e1387d898ee4 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:52.592590 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-b0126158-cb07-4e97-a742-e1387d898ee4 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/cbfe8395-a1da-4ff2-8951-0ffeaf568bae" status: 200 len: 1314 microversion: 2.1 time: 0.351552 Sep 16 09:52:52.594038 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 137/268] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:52 2022] GET /compute/v2.1/servers/cbfe8395-a1da-4ff2-8951-0ffeaf568bae => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:52:52.607371 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-e32f14d5-8882-4d10-85dd-9593b292e0a0 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:52.610981 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-e32f14d5-8882-4d10-85dd-9593b292e0a0 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 33e0e447-38a7-474d-ae32-1941ee3260c6] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:52.632101 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e32f14d5-8882-4d10-85dd-9593b292e0a0 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:52.632780 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e32f14d5-8882-4d10-85dd-9593b292e0a0 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:52.633307 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e32f14d5-8882-4d10-85dd-9593b292e0a0 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:52.634220 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e32f14d5-8882-4d10-85dd-9593b292e0a0 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:52.634945 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e32f14d5-8882-4d10-85dd-9593b292e0a0 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:52.635448 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e32f14d5-8882-4d10-85dd-9593b292e0a0 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:52.739619 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-e32f14d5-8882-4d10-85dd-9593b292e0a0 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:52.751615 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-e32f14d5-8882-4d10-85dd-9593b292e0a0 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6" status: 200 len: 1299 microversion: 2.1 time: 0.156055 Sep 16 09:52:52.752565 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 138/269] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:52 2022] GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6 => generated 1299 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:52:52.950609 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-eea338bd-dab0-466a-a0a0-6cf97f4127e7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:52.960347 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-eea338bd-dab0-466a-a0a0-6cf97f4127e7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:52.962127 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-9fae1eb4-5929-4bf4-af5a-574724b74246 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:52.962441 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-eea338bd-dab0-466a-a0a0-6cf97f4127e7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:52.963257 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-9fae1eb4-5929-4bf4-af5a-574724b74246 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: f634aa6d-e24c-48df-946f-3166fd76273a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:52.963884 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-eea338bd-dab0-466a-a0a0-6cf97f4127e7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1740 microversion: 2.20 time: 0.690958 Sep 16 09:52:52.964781 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 132/270] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:52:52 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1740 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:52:52.970749 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9fae1eb4-5929-4bf4-af5a-574724b74246 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:52.972204 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9fae1eb4-5929-4bf4-af5a-574724b74246 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:52.972863 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9fae1eb4-5929-4bf4-af5a-574724b74246 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:52.973806 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9fae1eb4-5929-4bf4-af5a-574724b74246 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:52.984276 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9fae1eb4-5929-4bf4-af5a-574724b74246 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:52.984276 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9fae1eb4-5929-4bf4-af5a-574724b74246 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:53.185741 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-9fae1eb4-5929-4bf4-af5a-574724b74246 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:53.194498 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-9fae1eb4-5929-4bf4-af5a-574724b74246 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a" status: 200 len: 1522 microversion: 2.1 time: 0.236609 Sep 16 09:52:53.195081 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 139/271] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:52 2022] GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:52:53.618074 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-01ee5464-cbba-4be2-8412-335ace287ea8 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:53.618789 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-01ee5464-cbba-4be2-8412-335ace287ea8 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: cbfe8395-a1da-4ff2-8951-0ffeaf568bae] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:53.626664 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-01ee5464-cbba-4be2-8412-335ace287ea8 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:53.628264 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-01ee5464-cbba-4be2-8412-335ace287ea8 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:53.629080 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-01ee5464-cbba-4be2-8412-335ace287ea8 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:53.630642 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-01ee5464-cbba-4be2-8412-335ace287ea8 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:53.631473 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-01ee5464-cbba-4be2-8412-335ace287ea8 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:53.632226 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-01ee5464-cbba-4be2-8412-335ace287ea8 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:53.666226 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [req-4f98b5af-d475-4c78-9d0d-f8e68aaf47ff req-dc3d281b-5be8-4a88-879a-056e2e0cfe7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbfe8395-a1da-4ff2-8951-0ffeaf568bae", "tag": "a3098220-05f9-42ce-a47c-128a2ad67619"}]} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:52:53.677361 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-4f98b5af-d475-4c78-9d0d-f8e68aaf47ff req-dc3d281b-5be8-4a88-879a-056e2e0cfe7e service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:53.678214 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-4f98b5af-d475-4c78-9d0d-f8e68aaf47ff req-dc3d281b-5be8-4a88-879a-056e2e0cfe7e service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:53.680981 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-4f98b5af-d475-4c78-9d0d-f8e68aaf47ff req-dc3d281b-5be8-4a88-879a-056e2e0cfe7e service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:53.696044 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.compute.server_external_events [req-4f98b5af-d475-4c78-9d0d-f8e68aaf47ff req-dc3d281b-5be8-4a88-879a-056e2e0cfe7e service nova] Creating event network-changed:a3098220-05f9-42ce-a47c-128a2ad67619 for instance cbfe8395-a1da-4ff2-8951-0ffeaf568bae on hv-cinder-79053 Sep 16 09:52:53.701518 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [req-4f98b5af-d475-4c78-9d0d-f8e68aaf47ff req-dc3d281b-5be8-4a88-879a-056e2e0cfe7e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038934 Sep 16 09:52:53.702728 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 140/272] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:52:53.783300 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-1e9a66b1-0260-4015-a93e-185665282243 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:53.784022 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-1e9a66b1-0260-4015-a93e-185665282243 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 33e0e447-38a7-474d-ae32-1941ee3260c6] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:53.790926 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1e9a66b1-0260-4015-a93e-185665282243 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:53.791426 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1e9a66b1-0260-4015-a93e-185665282243 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:53.791870 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1e9a66b1-0260-4015-a93e-185665282243 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:53.792708 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1e9a66b1-0260-4015-a93e-185665282243 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:53.793843 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1e9a66b1-0260-4015-a93e-185665282243 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:53.794449 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1e9a66b1-0260-4015-a93e-185665282243 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:53.822177 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-01ee5464-cbba-4be2-8412-335ace287ea8 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:53.841819 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-01ee5464-cbba-4be2-8412-335ace287ea8 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/cbfe8395-a1da-4ff2-8951-0ffeaf568bae" status: 200 len: 1314 microversion: 2.1 time: 0.227696 Sep 16 09:52:53.857746 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 133/273] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:53 2022] GET /compute/v2.1/servers/cbfe8395-a1da-4ff2-8951-0ffeaf568bae => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:52:53.946464 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-1e9a66b1-0260-4015-a93e-185665282243 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:53.951830 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-1e9a66b1-0260-4015-a93e-185665282243 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6" status: 200 len: 1367 microversion: 2.1 time: 0.173117 Sep 16 09:52:53.952418 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 141/274] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:53 2022] GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:52:53.992484 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-8dea1209-ec66-4344-988b-2ef612dbc7b9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:53.993128 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-8dea1209-ec66-4344-988b-2ef612dbc7b9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:53.999390 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8dea1209-ec66-4344-988b-2ef612dbc7b9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:53.999909 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8dea1209-ec66-4344-988b-2ef612dbc7b9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:54.000341 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8dea1209-ec66-4344-988b-2ef612dbc7b9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:54.001060 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8dea1209-ec66-4344-988b-2ef612dbc7b9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:54.001512 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8dea1209-ec66-4344-988b-2ef612dbc7b9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:54.001978 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8dea1209-ec66-4344-988b-2ef612dbc7b9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:54.153905 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-8dea1209-ec66-4344-988b-2ef612dbc7b9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:54.173229 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-8dea1209-ec66-4344-988b-2ef612dbc7b9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:54.173658 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-8dea1209-ec66-4344-988b-2ef612dbc7b9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:54.175574 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-8dea1209-ec66-4344-988b-2ef612dbc7b9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1740 microversion: 2.20 time: 0.186945 Sep 16 09:52:54.176394 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 134/275] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:52:53 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1740 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:52:54.218502 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-25c98649-1431-4c33-be2f-62adf114c24c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:54.219239 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-25c98649-1431-4c33-be2f-62adf114c24c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: f634aa6d-e24c-48df-946f-3166fd76273a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:54.226358 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-25c98649-1431-4c33-be2f-62adf114c24c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:54.226956 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-25c98649-1431-4c33-be2f-62adf114c24c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:54.227403 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-25c98649-1431-4c33-be2f-62adf114c24c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:54.228115 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-25c98649-1431-4c33-be2f-62adf114c24c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:54.228621 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-25c98649-1431-4c33-be2f-62adf114c24c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:54.229054 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-25c98649-1431-4c33-be2f-62adf114c24c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:54.368415 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-25c98649-1431-4c33-be2f-62adf114c24c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:54.376777 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-25c98649-1431-4c33-be2f-62adf114c24c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a" status: 200 len: 1522 microversion: 2.1 time: 0.162393 Sep 16 09:52:54.377498 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 142/276] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:54 2022] GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:52:54.864943 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d5f4e32b-d9f5-4bbe-8895-6bac641c51d7 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:54.865595 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-d5f4e32b-d9f5-4bbe-8895-6bac641c51d7 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: cbfe8395-a1da-4ff2-8951-0ffeaf568bae] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:54.872917 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d5f4e32b-d9f5-4bbe-8895-6bac641c51d7 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:54.873414 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d5f4e32b-d9f5-4bbe-8895-6bac641c51d7 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:54.873942 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d5f4e32b-d9f5-4bbe-8895-6bac641c51d7 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:54.874650 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d5f4e32b-d9f5-4bbe-8895-6bac641c51d7 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:54.875113 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d5f4e32b-d9f5-4bbe-8895-6bac641c51d7 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:54.875543 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d5f4e32b-d9f5-4bbe-8895-6bac641c51d7 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:54.976469 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-35ef9bd7-bc6f-42b7-b3dd-3b5500e77ab5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:54.977273 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-35ef9bd7-bc6f-42b7-b3dd-3b5500e77ab5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 33e0e447-38a7-474d-ae32-1941ee3260c6] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:54.984310 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-35ef9bd7-bc6f-42b7-b3dd-3b5500e77ab5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:54.984808 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-35ef9bd7-bc6f-42b7-b3dd-3b5500e77ab5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:54.985392 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-35ef9bd7-bc6f-42b7-b3dd-3b5500e77ab5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:54.985989 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-35ef9bd7-bc6f-42b7-b3dd-3b5500e77ab5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:54.986485 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-35ef9bd7-bc6f-42b7-b3dd-3b5500e77ab5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:54.986917 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-35ef9bd7-bc6f-42b7-b3dd-3b5500e77ab5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:55.037809 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-d5f4e32b-d9f5-4bbe-8895-6bac641c51d7 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:55.045673 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-d5f4e32b-d9f5-4bbe-8895-6bac641c51d7 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/cbfe8395-a1da-4ff2-8951-0ffeaf568bae" status: 200 len: 1314 microversion: 2.1 time: 0.184745 Sep 16 09:52:55.054549 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 135/277] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:54 2022] GET /compute/v2.1/servers/cbfe8395-a1da-4ff2-8951-0ffeaf568bae => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:52:55.136975 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-35ef9bd7-bc6f-42b7-b3dd-3b5500e77ab5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:55.145933 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-35ef9bd7-bc6f-42b7-b3dd-3b5500e77ab5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6" status: 200 len: 1367 microversion: 2.1 time: 0.173421 Sep 16 09:52:55.146522 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 143/278] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:54 2022] GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:52:55.202120 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-4930a004-9b82-4e61-983e-456e5d08cfe2 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:55.202747 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-4930a004-9b82-4e61-983e-456e5d08cfe2 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:55.209360 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4930a004-9b82-4e61-983e-456e5d08cfe2 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:55.209879 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4930a004-9b82-4e61-983e-456e5d08cfe2 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:55.210323 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4930a004-9b82-4e61-983e-456e5d08cfe2 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:55.211025 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4930a004-9b82-4e61-983e-456e5d08cfe2 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:55.211519 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4930a004-9b82-4e61-983e-456e5d08cfe2 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:55.211910 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4930a004-9b82-4e61-983e-456e5d08cfe2 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:55.352790 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-4930a004-9b82-4e61-983e-456e5d08cfe2 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:55.361197 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-4930a004-9b82-4e61-983e-456e5d08cfe2 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:55.363244 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-4930a004-9b82-4e61-983e-456e5d08cfe2 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:55.364445 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-4930a004-9b82-4e61-983e-456e5d08cfe2 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1740 microversion: 2.20 time: 0.166246 Sep 16 09:52:55.365009 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 136/279] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:52:55 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1740 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:52:55.401509 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-7251e49e-32b4-4d1c-9e33-7c768749676b tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:55.402274 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-7251e49e-32b4-4d1c-9e33-7c768749676b tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: f634aa6d-e24c-48df-946f-3166fd76273a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:55.408551 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7251e49e-32b4-4d1c-9e33-7c768749676b tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:55.409334 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7251e49e-32b4-4d1c-9e33-7c768749676b tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:55.409971 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7251e49e-32b4-4d1c-9e33-7c768749676b tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:55.410779 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7251e49e-32b4-4d1c-9e33-7c768749676b tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:55.411251 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7251e49e-32b4-4d1c-9e33-7c768749676b tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:55.411681 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7251e49e-32b4-4d1c-9e33-7c768749676b tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:55.554857 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-7251e49e-32b4-4d1c-9e33-7c768749676b tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:55.563192 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-7251e49e-32b4-4d1c-9e33-7c768749676b tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a" status: 200 len: 1522 microversion: 2.1 time: 0.166346 Sep 16 09:52:55.563773 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 144/280] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:55 2022] GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:52:56.068914 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-20d4e4e6-260f-4d91-a095-d292ff38a1a7 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:56.069575 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-20d4e4e6-260f-4d91-a095-d292ff38a1a7 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: cbfe8395-a1da-4ff2-8951-0ffeaf568bae] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:56.076109 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-20d4e4e6-260f-4d91-a095-d292ff38a1a7 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:56.076607 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-20d4e4e6-260f-4d91-a095-d292ff38a1a7 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:56.077047 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-20d4e4e6-260f-4d91-a095-d292ff38a1a7 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:56.077808 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-20d4e4e6-260f-4d91-a095-d292ff38a1a7 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:56.078271 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-20d4e4e6-260f-4d91-a095-d292ff38a1a7 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:56.078699 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-20d4e4e6-260f-4d91-a095-d292ff38a1a7 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:56.169789 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-e27537f9-9c1e-433d-bfe3-e83af649e4fe tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:56.170417 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-e27537f9-9c1e-433d-bfe3-e83af649e4fe tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 33e0e447-38a7-474d-ae32-1941ee3260c6] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:56.172359 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell0:SELECT=4 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:52:56.178376 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e27537f9-9c1e-433d-bfe3-e83af649e4fe tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:56.178877 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e27537f9-9c1e-433d-bfe3-e83af649e4fe tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:56.179319 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e27537f9-9c1e-433d-bfe3-e83af649e4fe tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:56.180024 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e27537f9-9c1e-433d-bfe3-e83af649e4fe tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:56.180496 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e27537f9-9c1e-433d-bfe3-e83af649e4fe tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:56.180928 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e27537f9-9c1e-433d-bfe3-e83af649e4fe tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:56.218884 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-20d4e4e6-260f-4d91-a095-d292ff38a1a7 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:56.222155 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=100 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:52:56.228548 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-20d4e4e6-260f-4d91-a095-d292ff38a1a7 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/cbfe8395-a1da-4ff2-8951-0ffeaf568bae" status: 200 len: 1314 microversion: 2.1 time: 0.164290 Sep 16 09:52:56.246060 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 137/281] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:56 2022] GET /compute/v2.1/servers/cbfe8395-a1da-4ff2-8951-0ffeaf568bae => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:52:56.328062 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-e27537f9-9c1e-433d-bfe3-e83af649e4fe tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:56.331607 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell1:SELECT=100 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:52:56.336760 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-e27537f9-9c1e-433d-bfe3-e83af649e4fe tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6" status: 200 len: 1367 microversion: 2.1 time: 0.170789 Sep 16 09:52:56.337347 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 145/282] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:56 2022] GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:52:56.391711 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-3a06149b-192f-4b09-9f0b-8c39e063db78 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:56.393123 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-3a06149b-192f-4b09-9f0b-8c39e063db78 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:56.399503 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3a06149b-192f-4b09-9f0b-8c39e063db78 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:56.399986 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3a06149b-192f-4b09-9f0b-8c39e063db78 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:56.400415 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3a06149b-192f-4b09-9f0b-8c39e063db78 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:56.401157 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3a06149b-192f-4b09-9f0b-8c39e063db78 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:56.401649 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3a06149b-192f-4b09-9f0b-8c39e063db78 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:56.402072 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3a06149b-192f-4b09-9f0b-8c39e063db78 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:56.545235 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-3a06149b-192f-4b09-9f0b-8c39e063db78 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:56.555186 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-3a06149b-192f-4b09-9f0b-8c39e063db78 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:56.556637 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-3a06149b-192f-4b09-9f0b-8c39e063db78 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:56.557982 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-3a06149b-192f-4b09-9f0b-8c39e063db78 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1740 microversion: 2.20 time: 0.171492 Sep 16 09:52:56.558411 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 138/283] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:52:56 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1740 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:52:56.587110 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-9a5d38da-65ad-42ef-b95f-efd53c90ab4c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:56.587729 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-9a5d38da-65ad-42ef-b95f-efd53c90ab4c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: f634aa6d-e24c-48df-946f-3166fd76273a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:56.594208 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9a5d38da-65ad-42ef-b95f-efd53c90ab4c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:56.594700 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9a5d38da-65ad-42ef-b95f-efd53c90ab4c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:56.595146 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9a5d38da-65ad-42ef-b95f-efd53c90ab4c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:56.595841 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9a5d38da-65ad-42ef-b95f-efd53c90ab4c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:56.597040 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9a5d38da-65ad-42ef-b95f-efd53c90ab4c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:56.597715 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9a5d38da-65ad-42ef-b95f-efd53c90ab4c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:56.733125 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-9a5d38da-65ad-42ef-b95f-efd53c90ab4c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:56.741248 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-9a5d38da-65ad-42ef-b95f-efd53c90ab4c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a" status: 200 len: 1522 microversion: 2.1 time: 0.158085 Sep 16 09:52:56.741932 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 146/284] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:56 2022] GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:52:57.253569 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-77906877-05a5-4105-a673-bfcfe597fca9 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:57.254291 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-77906877-05a5-4105-a673-bfcfe597fca9 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: cbfe8395-a1da-4ff2-8951-0ffeaf568bae] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:57.260868 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-77906877-05a5-4105-a673-bfcfe597fca9 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:57.261368 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-77906877-05a5-4105-a673-bfcfe597fca9 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:57.261883 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-77906877-05a5-4105-a673-bfcfe597fca9 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:57.262581 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-77906877-05a5-4105-a673-bfcfe597fca9 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:57.263074 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-77906877-05a5-4105-a673-bfcfe597fca9 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:57.263512 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-77906877-05a5-4105-a673-bfcfe597fca9 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:57.368018 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-3c5885dc-70ac-4c3e-bf91-b12d290a72ee tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:57.368668 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-3c5885dc-70ac-4c3e-bf91-b12d290a72ee tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 33e0e447-38a7-474d-ae32-1941ee3260c6] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:57.375142 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3c5885dc-70ac-4c3e-bf91-b12d290a72ee tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:57.375645 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3c5885dc-70ac-4c3e-bf91-b12d290a72ee tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:57.376091 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3c5885dc-70ac-4c3e-bf91-b12d290a72ee tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:57.377880 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3c5885dc-70ac-4c3e-bf91-b12d290a72ee tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:57.379348 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3c5885dc-70ac-4c3e-bf91-b12d290a72ee tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:57.379796 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3c5885dc-70ac-4c3e-bf91-b12d290a72ee tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:57.413196 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-77906877-05a5-4105-a673-bfcfe597fca9 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:57.421626 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-77906877-05a5-4105-a673-bfcfe597fca9 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/cbfe8395-a1da-4ff2-8951-0ffeaf568bae" status: 200 len: 1314 microversion: 2.1 time: 0.173036 Sep 16 09:52:57.422205 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 139/285] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:57 2022] GET /compute/v2.1/servers/cbfe8395-a1da-4ff2-8951-0ffeaf568bae => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:52:57.525601 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-3c5885dc-70ac-4c3e-bf91-b12d290a72ee tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:57.533275 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-3c5885dc-70ac-4c3e-bf91-b12d290a72ee tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6" status: 200 len: 1367 microversion: 2.1 time: 0.171516 Sep 16 09:52:57.534078 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 147/286] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:57 2022] GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:52:57.583030 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-3e28f4e4-8f38-4810-9a11-30bbab6292d1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:57.583645 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-3e28f4e4-8f38-4810-9a11-30bbab6292d1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:57.589657 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3e28f4e4-8f38-4810-9a11-30bbab6292d1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:57.590151 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3e28f4e4-8f38-4810-9a11-30bbab6292d1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:57.590589 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3e28f4e4-8f38-4810-9a11-30bbab6292d1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:57.591289 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3e28f4e4-8f38-4810-9a11-30bbab6292d1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:57.591747 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3e28f4e4-8f38-4810-9a11-30bbab6292d1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:57.592175 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3e28f4e4-8f38-4810-9a11-30bbab6292d1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:57.771248 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-bc81c485-f52c-4d90-a183-c39257b3eb71 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:57.772613 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-bc81c485-f52c-4d90-a183-c39257b3eb71 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: f634aa6d-e24c-48df-946f-3166fd76273a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:57.780271 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-bc81c485-f52c-4d90-a183-c39257b3eb71 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:57.780778 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-bc81c485-f52c-4d90-a183-c39257b3eb71 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:57.781224 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-bc81c485-f52c-4d90-a183-c39257b3eb71 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:57.782191 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-bc81c485-f52c-4d90-a183-c39257b3eb71 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:57.782441 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-bc81c485-f52c-4d90-a183-c39257b3eb71 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:57.782868 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-bc81c485-f52c-4d90-a183-c39257b3eb71 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:57.851893 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-3e28f4e4-8f38-4810-9a11-30bbab6292d1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:57.861928 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-3e28f4e4-8f38-4810-9a11-30bbab6292d1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:57.864717 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-3e28f4e4-8f38-4810-9a11-30bbab6292d1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:57.866086 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-3e28f4e4-8f38-4810-9a11-30bbab6292d1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1740 microversion: 2.20 time: 0.287096 Sep 16 09:52:57.866842 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 140/287] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:52:57 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1740 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 09:52:57.891691 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-68d420f4-7b4b-4c6c-9a43-977799a36516 req-463b1bca-738a-4305-bef7-fe100bbb76ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88a0813e-ace7-48df-b688-533c8dbc81de", "name": "network-vif-plugged", "status": "completed", "tag": "55883b34-2ac0-4ba3-b4af-c5503b0d8fc9"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:52:57.903251 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-68d420f4-7b4b-4c6c-9a43-977799a36516 req-463b1bca-738a-4305-bef7-fe100bbb76ff service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:57.904173 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-68d420f4-7b4b-4c6c-9a43-977799a36516 req-463b1bca-738a-4305-bef7-fe100bbb76ff service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:57.904173 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-68d420f4-7b4b-4c6c-9a43-977799a36516 req-463b1bca-738a-4305-bef7-fe100bbb76ff service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:57.916759 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-68d420f4-7b4b-4c6c-9a43-977799a36516 req-463b1bca-738a-4305-bef7-fe100bbb76ff service nova] Creating event network-vif-plugged:55883b34-2ac0-4ba3-b4af-c5503b0d8fc9 for instance 88a0813e-ace7-48df-b688-533c8dbc81de on hv-cinder-79053 Sep 16 09:52:57.922730 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-68d420f4-7b4b-4c6c-9a43-977799a36516 req-463b1bca-738a-4305-bef7-fe100bbb76ff service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037381 Sep 16 09:52:57.923410 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 141/288] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:52:58.042149 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-bc81c485-f52c-4d90-a183-c39257b3eb71 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:58.052971 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-bc81c485-f52c-4d90-a183-c39257b3eb71 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a" status: 200 len: 1522 microversion: 2.1 time: 0.290802 Sep 16 09:52:58.053602 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 148/289] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:57 2022] GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:52:58.445983 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-f3ab1856-785a-4231-b27f-9e2e0ac2e5d6 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:58.446933 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-f3ab1856-785a-4231-b27f-9e2e0ac2e5d6 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: cbfe8395-a1da-4ff2-8951-0ffeaf568bae] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:58.454811 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:52:58.459117 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f3ab1856-785a-4231-b27f-9e2e0ac2e5d6 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:58.459751 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f3ab1856-785a-4231-b27f-9e2e0ac2e5d6 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:58.460197 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f3ab1856-785a-4231-b27f-9e2e0ac2e5d6 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:58.460923 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f3ab1856-785a-4231-b27f-9e2e0ac2e5d6 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:58.461378 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f3ab1856-785a-4231-b27f-9e2e0ac2e5d6 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:58.461826 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f3ab1856-785a-4231-b27f-9e2e0ac2e5d6 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:58.557203 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-fbffad54-74b6-449b-af28-cf9b30508d1d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:58.557923 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-fbffad54-74b6-449b-af28-cf9b30508d1d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 33e0e447-38a7-474d-ae32-1941ee3260c6] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:58.565357 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-fbffad54-74b6-449b-af28-cf9b30508d1d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:58.573749 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-fbffad54-74b6-449b-af28-cf9b30508d1d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:58.573749 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-fbffad54-74b6-449b-af28-cf9b30508d1d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:58.573749 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-fbffad54-74b6-449b-af28-cf9b30508d1d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:58.573749 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-fbffad54-74b6-449b-af28-cf9b30508d1d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:58.574164 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-fbffad54-74b6-449b-af28-cf9b30508d1d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:58.653201 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f3ab1856-785a-4231-b27f-9e2e0ac2e5d6 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:58.661788 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-f3ab1856-785a-4231-b27f-9e2e0ac2e5d6 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/cbfe8395-a1da-4ff2-8951-0ffeaf568bae" status: 200 len: 1314 microversion: 2.1 time: 0.220286 Sep 16 09:52:58.662377 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 142/290] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:58 2022] GET /compute/v2.1/servers/cbfe8395-a1da-4ff2-8951-0ffeaf568bae => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:52:58.706015 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-fbffad54-74b6-449b-af28-cf9b30508d1d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:58.715841 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-fbffad54-74b6-449b-af28-cf9b30508d1d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6" status: 200 len: 1367 microversion: 2.1 time: 0.162257 Sep 16 09:52:58.716506 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 149/291] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:58 2022] GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:52:58.741289 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-455da780-d827-4344-b3d2-4a37b10acade req-5a015189-2034-47a2-91a6-68bedce819f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33e0e447-38a7-474d-ae32-1941ee3260c6", "tag": "4108db2f-5c49-4ad6-ae61-afd84b76a0ce"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:52:58.746496 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell0:SELECT=4 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:52:58.751721 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-455da780-d827-4344-b3d2-4a37b10acade req-5a015189-2034-47a2-91a6-68bedce819f5 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:58.753011 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-455da780-d827-4344-b3d2-4a37b10acade req-5a015189-2034-47a2-91a6-68bedce819f5 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:58.753447 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-455da780-d827-4344-b3d2-4a37b10acade req-5a015189-2034-47a2-91a6-68bedce819f5 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:58.766958 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-455da780-d827-4344-b3d2-4a37b10acade req-5a015189-2034-47a2-91a6-68bedce819f5 service nova] Creating event network-changed:4108db2f-5c49-4ad6-ae61-afd84b76a0ce for instance 33e0e447-38a7-474d-ae32-1941ee3260c6 on hv-cinder-79053 Sep 16 09:52:58.774597 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-455da780-d827-4344-b3d2-4a37b10acade req-5a015189-2034-47a2-91a6-68bedce819f5 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037299 Sep 16 09:52:58.775197 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 143/292] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:52:58.896748 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-8ca415a3-243a-4bc1-9a96-86df2bac38c0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:58.897787 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-8ca415a3-243a-4bc1-9a96-86df2bac38c0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:58.906933 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8ca415a3-243a-4bc1-9a96-86df2bac38c0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:58.908007 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8ca415a3-243a-4bc1-9a96-86df2bac38c0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:58.908804 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8ca415a3-243a-4bc1-9a96-86df2bac38c0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:58.910203 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8ca415a3-243a-4bc1-9a96-86df2bac38c0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:58.911031 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8ca415a3-243a-4bc1-9a96-86df2bac38c0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:58.911697 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8ca415a3-243a-4bc1-9a96-86df2bac38c0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:59.073673 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell0:SELECT=18 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:52:59.078913 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-7884c0a2-c10a-40b6-96db-3c85292f2478 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:59.079614 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-7884c0a2-c10a-40b6-96db-3c85292f2478 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: f634aa6d-e24c-48df-946f-3166fd76273a] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:59.088740 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7884c0a2-c10a-40b6-96db-3c85292f2478 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:59.088740 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7884c0a2-c10a-40b6-96db-3c85292f2478 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:59.088956 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7884c0a2-c10a-40b6-96db-3c85292f2478 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:59.089618 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7884c0a2-c10a-40b6-96db-3c85292f2478 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:59.090616 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7884c0a2-c10a-40b6-96db-3c85292f2478 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:59.091144 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7884c0a2-c10a-40b6-96db-3c85292f2478 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:59.210727 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-8ca415a3-243a-4bc1-9a96-86df2bac38c0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:59.227244 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-8ca415a3-243a-4bc1-9a96-86df2bac38c0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:59.229353 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-8ca415a3-243a-4bc1-9a96-86df2bac38c0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:59.231203 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-8ca415a3-243a-4bc1-9a96-86df2bac38c0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1740 microversion: 2.20 time: 0.338797 Sep 16 09:52:59.254083 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 150/293] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:52:58 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1740 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:52:59.336246 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-7884c0a2-c10a-40b6-96db-3c85292f2478 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:59.344194 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-7884c0a2-c10a-40b6-96db-3c85292f2478 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a" status: 200 len: 1522 microversion: 2.1 time: 0.271485 Sep 16 09:52:59.344773 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 144/294] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:59 2022] GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:52:59.687898 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-5ba7765b-3d50-4fdb-875c-448d1aadb5b2 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:59.688930 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-5ba7765b-3d50-4fdb-875c-448d1aadb5b2 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: cbfe8395-a1da-4ff2-8951-0ffeaf568bae] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:59.697683 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5ba7765b-3d50-4fdb-875c-448d1aadb5b2 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:59.698298 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5ba7765b-3d50-4fdb-875c-448d1aadb5b2 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:59.698943 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5ba7765b-3d50-4fdb-875c-448d1aadb5b2 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:59.699882 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5ba7765b-3d50-4fdb-875c-448d1aadb5b2 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:59.700359 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5ba7765b-3d50-4fdb-875c-448d1aadb5b2 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:59.700793 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5ba7765b-3d50-4fdb-875c-448d1aadb5b2 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:59.740098 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-c50afe85-8508-4d1f-8b9b-76f58342139a tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:52:59.740704 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-c50afe85-8508-4d1f-8b9b-76f58342139a tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 33e0e447-38a7-474d-ae32-1941ee3260c6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:52:59.747351 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c50afe85-8508-4d1f-8b9b-76f58342139a tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:59.747847 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c50afe85-8508-4d1f-8b9b-76f58342139a tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:59.748282 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c50afe85-8508-4d1f-8b9b-76f58342139a tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:59.749004 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c50afe85-8508-4d1f-8b9b-76f58342139a tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:52:59.749471 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c50afe85-8508-4d1f-8b9b-76f58342139a tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:52:59.749976 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c50afe85-8508-4d1f-8b9b-76f58342139a tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:52:59.858238 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-5ba7765b-3d50-4fdb-875c-448d1aadb5b2 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:59.867274 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-5ba7765b-3d50-4fdb-875c-448d1aadb5b2 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/cbfe8395-a1da-4ff2-8951-0ffeaf568bae" status: 200 len: 1314 microversion: 2.1 time: 0.183682 Sep 16 09:52:59.867865 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 151/295] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:59 2022] GET /compute/v2.1/servers/cbfe8395-a1da-4ff2-8951-0ffeaf568bae => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:52:59.907871 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c50afe85-8508-4d1f-8b9b-76f58342139a tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:52:59.916462 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-c50afe85-8508-4d1f-8b9b-76f58342139a tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6" status: 200 len: 1367 microversion: 2.1 time: 0.181815 Sep 16 09:52:59.917033 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 145/296] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:52:59 2022] GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:53:00.265365 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-44f016f2-66d0-4815-bcdd-59f42826e28c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:00.266022 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-44f016f2-66d0-4815-bcdd-59f42826e28c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:00.273645 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-44f016f2-66d0-4815-bcdd-59f42826e28c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:00.274058 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-44f016f2-66d0-4815-bcdd-59f42826e28c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:00.274533 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-44f016f2-66d0-4815-bcdd-59f42826e28c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:00.275251 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-44f016f2-66d0-4815-bcdd-59f42826e28c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:00.275711 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-44f016f2-66d0-4815-bcdd-59f42826e28c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:00.276143 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-44f016f2-66d0-4815-bcdd-59f42826e28c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:00.368746 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-970994b8-16b1-45b3-ae3e-8664780afc0e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:00.369395 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-970994b8-16b1-45b3-ae3e-8664780afc0e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: f634aa6d-e24c-48df-946f-3166fd76273a] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:00.375677 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-970994b8-16b1-45b3-ae3e-8664780afc0e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:00.376482 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-970994b8-16b1-45b3-ae3e-8664780afc0e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:00.377283 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-970994b8-16b1-45b3-ae3e-8664780afc0e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:00.377815 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-970994b8-16b1-45b3-ae3e-8664780afc0e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:00.378332 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-970994b8-16b1-45b3-ae3e-8664780afc0e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:00.378825 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-970994b8-16b1-45b3-ae3e-8664780afc0e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:00.437284 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-44f016f2-66d0-4815-bcdd-59f42826e28c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:00.447601 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-44f016f2-66d0-4815-bcdd-59f42826e28c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:00.449105 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-44f016f2-66d0-4815-bcdd-59f42826e28c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:00.450364 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-44f016f2-66d0-4815-bcdd-59f42826e28c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1735 microversion: 2.20 time: 0.189248 Sep 16 09:53:00.453922 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 152/297] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:53:00 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1735 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:53:00.529401 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-970994b8-16b1-45b3-ae3e-8664780afc0e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:00.539892 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-970994b8-16b1-45b3-ae3e-8664780afc0e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a" status: 200 len: 1522 microversion: 2.1 time: 0.174729 Sep 16 09:53:00.540644 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 146/298] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:00 2022] GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:53:00.896243 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-e883a569-c285-4d99-970f-1c5738cd3861 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:00.897149 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-e883a569-c285-4d99-970f-1c5738cd3861 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: cbfe8395-a1da-4ff2-8951-0ffeaf568bae] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:00.903954 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e883a569-c285-4d99-970f-1c5738cd3861 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:00.903954 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e883a569-c285-4d99-970f-1c5738cd3861 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:00.903954 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e883a569-c285-4d99-970f-1c5738cd3861 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:00.915145 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e883a569-c285-4d99-970f-1c5738cd3861 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:00.915145 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e883a569-c285-4d99-970f-1c5738cd3861 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:00.915145 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e883a569-c285-4d99-970f-1c5738cd3861 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:00.940278 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-91b7de50-9f29-48fe-8db6-b338a92c5bf5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:00.941200 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-91b7de50-9f29-48fe-8db6-b338a92c5bf5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 33e0e447-38a7-474d-ae32-1941ee3260c6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:00.951203 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-91b7de50-9f29-48fe-8db6-b338a92c5bf5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:00.951952 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-91b7de50-9f29-48fe-8db6-b338a92c5bf5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:00.952399 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-91b7de50-9f29-48fe-8db6-b338a92c5bf5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:00.953447 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-91b7de50-9f29-48fe-8db6-b338a92c5bf5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:00.960597 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-91b7de50-9f29-48fe-8db6-b338a92c5bf5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:00.960597 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-91b7de50-9f29-48fe-8db6-b338a92c5bf5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:01.074041 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-e883a569-c285-4d99-970f-1c5738cd3861 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:01.083138 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-e883a569-c285-4d99-970f-1c5738cd3861 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/cbfe8395-a1da-4ff2-8951-0ffeaf568bae" status: 200 len: 1314 microversion: 2.1 time: 0.191515 Sep 16 09:53:01.083731 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 153/299] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:00 2022] GET /compute/v2.1/servers/cbfe8395-a1da-4ff2-8951-0ffeaf568bae => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:01.116253 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-91b7de50-9f29-48fe-8db6-b338a92c5bf5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:01.124444 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-91b7de50-9f29-48fe-8db6-b338a92c5bf5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6" status: 200 len: 1367 microversion: 2.1 time: 0.187976 Sep 16 09:53:01.138727 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 147/300] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:00 2022] GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6 => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:53:01.476463 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-283f21a9-26e5-4fe6-aa61-f3c5b2b72f10 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:01.477111 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-283f21a9-26e5-4fe6-aa61-f3c5b2b72f10 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:01.483850 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-283f21a9-26e5-4fe6-aa61-f3c5b2b72f10 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:01.484352 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-283f21a9-26e5-4fe6-aa61-f3c5b2b72f10 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:01.484835 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-283f21a9-26e5-4fe6-aa61-f3c5b2b72f10 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:01.485534 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-283f21a9-26e5-4fe6-aa61-f3c5b2b72f10 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:01.486047 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-283f21a9-26e5-4fe6-aa61-f3c5b2b72f10 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:01.486528 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-283f21a9-26e5-4fe6-aa61-f3c5b2b72f10 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:01.563368 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-acf5f4d0-9810-49b3-ad7a-5fd7f406c4c8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:01.564160 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-acf5f4d0-9810-49b3-ad7a-5fd7f406c4c8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: f634aa6d-e24c-48df-946f-3166fd76273a] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:01.572025 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-acf5f4d0-9810-49b3-ad7a-5fd7f406c4c8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:01.572903 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-acf5f4d0-9810-49b3-ad7a-5fd7f406c4c8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:01.573454 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-acf5f4d0-9810-49b3-ad7a-5fd7f406c4c8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:01.574314 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-acf5f4d0-9810-49b3-ad7a-5fd7f406c4c8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:01.574861 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-acf5f4d0-9810-49b3-ad7a-5fd7f406c4c8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:01.575543 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-acf5f4d0-9810-49b3-ad7a-5fd7f406c4c8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:01.635356 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-283f21a9-26e5-4fe6-aa61-f3c5b2b72f10 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:01.644523 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-283f21a9-26e5-4fe6-aa61-f3c5b2b72f10 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:01.646630 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-283f21a9-26e5-4fe6-aa61-f3c5b2b72f10 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:01.647956 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-283f21a9-26e5-4fe6-aa61-f3c5b2b72f10 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1735 microversion: 2.20 time: 0.175692 Sep 16 09:53:01.662642 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 154/301] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:53:01 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1735 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:53:01.723682 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-acf5f4d0-9810-49b3-ad7a-5fd7f406c4c8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:01.732439 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-acf5f4d0-9810-49b3-ad7a-5fd7f406c4c8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a" status: 200 len: 1522 microversion: 2.1 time: 0.172997 Sep 16 09:53:01.733027 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 148/302] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:01 2022] GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:53:02.110572 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-5d442b2e-db96-42a7-ad03-5cd47706abf0 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:02.111436 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-5d442b2e-db96-42a7-ad03-5cd47706abf0 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: cbfe8395-a1da-4ff2-8951-0ffeaf568bae] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:02.117721 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5d442b2e-db96-42a7-ad03-5cd47706abf0 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:02.118207 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5d442b2e-db96-42a7-ad03-5cd47706abf0 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:02.118642 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5d442b2e-db96-42a7-ad03-5cd47706abf0 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:02.119336 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5d442b2e-db96-42a7-ad03-5cd47706abf0 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:02.119806 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5d442b2e-db96-42a7-ad03-5cd47706abf0 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:02.120279 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5d442b2e-db96-42a7-ad03-5cd47706abf0 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:02.149382 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-1f35d8c6-f18c-45bd-bc82-6fb5e43d46a9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:02.154372 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-1f35d8c6-f18c-45bd-bc82-6fb5e43d46a9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 33e0e447-38a7-474d-ae32-1941ee3260c6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:02.156375 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1f35d8c6-f18c-45bd-bc82-6fb5e43d46a9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:02.156860 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1f35d8c6-f18c-45bd-bc82-6fb5e43d46a9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:02.157292 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1f35d8c6-f18c-45bd-bc82-6fb5e43d46a9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:02.158010 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1f35d8c6-f18c-45bd-bc82-6fb5e43d46a9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:02.158683 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1f35d8c6-f18c-45bd-bc82-6fb5e43d46a9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:02.159118 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1f35d8c6-f18c-45bd-bc82-6fb5e43d46a9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:02.254009 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-5d442b2e-db96-42a7-ad03-5cd47706abf0 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:02.261840 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-5d442b2e-db96-42a7-ad03-5cd47706abf0 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/cbfe8395-a1da-4ff2-8951-0ffeaf568bae" status: 200 len: 1314 microversion: 2.1 time: 0.155060 Sep 16 09:53:02.262430 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 155/303] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:02 2022] GET /compute/v2.1/servers/cbfe8395-a1da-4ff2-8951-0ffeaf568bae => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:02.294246 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-1f35d8c6-f18c-45bd-bc82-6fb5e43d46a9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:02.303400 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-1f35d8c6-f18c-45bd-bc82-6fb5e43d46a9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6" status: 200 len: 1367 microversion: 2.1 time: 0.157853 Sep 16 09:53:02.304003 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 149/304] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:02 2022] GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:02.691306 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-796f601e-be88-49f5-9125-a2267b32c49e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:02.692049 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-796f601e-be88-49f5-9125-a2267b32c49e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:02.698539 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-796f601e-be88-49f5-9125-a2267b32c49e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:02.699030 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-796f601e-be88-49f5-9125-a2267b32c49e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:02.699475 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-796f601e-be88-49f5-9125-a2267b32c49e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:02.700180 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-796f601e-be88-49f5-9125-a2267b32c49e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:02.700645 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-796f601e-be88-49f5-9125-a2267b32c49e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:02.701081 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-796f601e-be88-49f5-9125-a2267b32c49e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:02.759294 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d67b9b1c-0d37-4f06-86f0-1c6f3cbcfe16 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:02.760671 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-d67b9b1c-0d37-4f06-86f0-1c6f3cbcfe16 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: f634aa6d-e24c-48df-946f-3166fd76273a] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:02.773557 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d67b9b1c-0d37-4f06-86f0-1c6f3cbcfe16 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:02.774359 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d67b9b1c-0d37-4f06-86f0-1c6f3cbcfe16 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:02.775430 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d67b9b1c-0d37-4f06-86f0-1c6f3cbcfe16 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:02.776909 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d67b9b1c-0d37-4f06-86f0-1c6f3cbcfe16 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:02.777648 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d67b9b1c-0d37-4f06-86f0-1c6f3cbcfe16 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:02.778335 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d67b9b1c-0d37-4f06-86f0-1c6f3cbcfe16 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:02.915923 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-796f601e-be88-49f5-9125-a2267b32c49e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:02.924446 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-796f601e-be88-49f5-9125-a2267b32c49e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:02.926279 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-796f601e-be88-49f5-9125-a2267b32c49e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:02.927654 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-796f601e-be88-49f5-9125-a2267b32c49e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1735 microversion: 2.20 time: 0.241177 Sep 16 09:53:02.928188 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 156/305] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:53:02 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1735 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:53:02.949497 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-d67b9b1c-0d37-4f06-86f0-1c6f3cbcfe16 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:02.958382 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-d67b9b1c-0d37-4f06-86f0-1c6f3cbcfe16 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a" status: 200 len: 1502 microversion: 2.1 time: 0.205424 Sep 16 09:53:02.958959 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 150/306] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:02 2022] GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a => generated 1502 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:02.982485 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-f71beceb-2045-461e-b370-e6a5f0a81be4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bb529a36-c336-4d3a-bb9d-c06cef42ce86"}} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:53:02.986487 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-f71beceb-2045-461e-b370-e6a5f0a81be4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: f634aa6d-e24c-48df-946f-3166fd76273a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:02.994034 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f71beceb-2045-461e-b370-e6a5f0a81be4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:02.994833 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f71beceb-2045-461e-b370-e6a5f0a81be4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:02.995511 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f71beceb-2045-461e-b370-e6a5f0a81be4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:02.996378 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f71beceb-2045-461e-b370-e6a5f0a81be4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:02.996843 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f71beceb-2045-461e-b370-e6a5f0a81be4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:02.997495 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f71beceb-2045-461e-b370-e6a5f0a81be4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:03.026136 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.wsgi [None req-f71beceb-2045-461e-b370-e6a5f0a81be4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] HTTP exception thrown: Cannot 'attach_volume' instance f634aa6d-e24c-48df-946f-3166fd76273a while it is in vm_state rescued Sep 16 09:53:03.028171 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-f71beceb-2045-461e-b370-e6a5f0a81be4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Request method failure captured: Sep 16 09:53:03.028171 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: request: POST /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a/os-volume_attachments HTTP/1.1 Sep 16 09:53:03.028171 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept: application/json Sep 16 09:53:03.028171 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept-Encoding: identity Sep 16 09:53:03.028171 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Connection: close Sep 16 09:53:03.028171 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Length: 74 Sep 16 09:53:03.028171 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Type: application/json Sep 16 09:53:03.028171 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Host: 10.222.0.73 Sep 16 09:53:03.028171 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Openstack-System-Scope: None Sep 16 09:53:03.028171 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: User-Agent: python-urllib3/1.26.12 Sep 16 09:53:03.028171 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Auth-Token: gAAAAABjJEbxR-3pAhLiwb3ckUO6s_con7PzqaMH7LIfbFMfWWksbJi1GgWKz99k_xTyog5rd5nWR-OSR9_6_XhX2Wo2YD5uM25GUSMoNymOY18MnkEv9j1oga2G7G47Yhfh-dJVj2X4Cf2GB-s6CbFgJzG7jcNz64ctztxMfjiQALnI2E37Lf0 Sep 16 09:53:03.028171 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Id: None Sep 16 09:53:03.028171 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Name: None Sep 16 09:53:03.028171 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Identity-Status: Confirmed Sep 16 09:53:03.028171 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Is-Admin-Project: True Sep 16 09:53:03.028171 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Id: default Sep 16 09:53:03.028171 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Name: Default Sep 16 09:53:03.028171 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Id: 3fe0d52d42324aa38182b47b3588b979 Sep 16 09:53:03.028171 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1278542283 Sep 16 09:53:03.028171 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Role: reader,member Sep 16 09:53:03.028171 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Roles: reader,member Sep 16 09:53:03.029866 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/3fe0d52d42324aa38182b47b3588b979"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_3fe0d52d42324aa38182b47b3588b979", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/3fe0d52d42324aa38182b47b3588b979"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/3fe0d52d42324aa38182b47b3588b979"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 09:53:03.029866 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1278542283 Sep 16 09:53:03.029866 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Id: 3fe0d52d42324aa38182b47b3588b979 Sep 16 09:53:03.029866 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1278542283 Sep 16 09:53:03.029866 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User: tempest-ServerRescueNegativeTestJSON-1278542283-project Sep 16 09:53:03.029866 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Id: default Sep 16 09:53:03.029866 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Name: Default Sep 16 09:53:03.029866 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Id: 8d1ce0bdadbc48d2899c7cdded5acb5c Sep 16 09:53:03.029866 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1278542283-project Sep 16 09:53:03.029866 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Sep 16 09:53:03.029866 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: {"volumeAttachment": {"volumeId": "bb529a36-c336-4d3a-bb9d-c06cef42ce86"}} Sep 16 09:53:03.029866 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: method: > Sep 16 09:53:03.035305 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: exception: Cannot 'attach_volume' instance f634aa6d-e24c-48df-946f-3166fd76273a while it is in vm_state rescued Sep 16 09:53:03.035305 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: action_args: {'server_id': 'f634aa6d-e24c-48df-946f-3166fd76273a', 'body': {'volumeAttachment': {'volumeId': 'bb529a36-c336-4d3a-bb9d-c06cef42ce86'}}} Sep 16 09:53:03.035305 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 09:53:03.035305 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:53:03.035305 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 16 09:53:03.035305 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 16 09:53:03.035305 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 16 09:53:03.035305 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 16 09:53:03.035305 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 16 09:53:03.035305 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 16 09:53:03.035305 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f634aa6d-e24c-48df-946f-3166fd76273a in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 16 09:53:03.035305 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:53:03.035305 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:53:03.035305 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:53:03.035305 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:53:03.035305 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:53:03.035305 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:53:03.035305 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 09:53:03.035305 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 09:53:03.036448 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 09:53:03.036448 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:53:03.036448 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 09:53:03.036448 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 09:53:03.036448 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 09:53:03.036448 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 09:53:03.036448 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 09:53:03.036448 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 09:53:03.036448 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 16 09:53:03.036448 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 16 09:53:03.036448 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 16 09:53:03.036448 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 16 09:53:03.036448 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance f634aa6d-e24c-48df-946f-3166fd76273a while it is in vm_state rescued Sep 16 09:53:03.036448 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:53:03.036448 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:53:03.036448 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:53:03.036448 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:53:03.036448 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:53:03.036448 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:53:03.037765 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 09:53:03.037765 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 09:53:03.037765 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance f634aa6d-e24c-48df-946f-3166fd76273a while it is in vm_state rescued Sep 16 09:53:03.037765 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:53:03.037765 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-f71beceb-2045-461e-b370-e6a5f0a81be4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Returning 409 to user: Cannot 'attach_volume' instance f634aa6d-e24c-48df-946f-3166fd76273a while it is in vm_state rescued {{(pid=127671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 09:53:03.037765 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-f71beceb-2045-461e-b370-e6a5f0a81be4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "POST /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.051089 Sep 16 09:53:03.037765 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 157/307] 10.222.0.73 () {60 vars in 1323 bytes} [Fri Sep 16 09:53:02 2022] POST /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a/os-volume_attachments => generated 152 bytes in 52 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 16 09:53:03.039377 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-6830cd8d-cba8-467d-9365-f0c41aa36a03 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:53:03.039942 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-6830cd8d-cba8-467d-9365-f0c41aa36a03 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: f634aa6d-e24c-48df-946f-3166fd76273a] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:03.045856 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6830cd8d-cba8-467d-9365-f0c41aa36a03 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:03.046341 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6830cd8d-cba8-467d-9365-f0c41aa36a03 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:03.046782 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6830cd8d-cba8-467d-9365-f0c41aa36a03 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:03.047551 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6830cd8d-cba8-467d-9365-f0c41aa36a03 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:03.048011 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6830cd8d-cba8-467d-9365-f0c41aa36a03 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:03.048430 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6830cd8d-cba8-467d-9365-f0c41aa36a03 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:03.291431 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-6830cd8d-cba8-467d-9365-f0c41aa36a03 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "POST /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a/action" status: 202 len: 0 microversion: 2.1 time: 0.255661 Sep 16 09:53:03.292609 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 151/308] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Sep 16 09:53:03 2022] POST /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 09:53:03.292926 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-899387f0-fed0-4fd9-bd91-eefd007b8801 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:03.295345 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-899387f0-fed0-4fd9-bd91-eefd007b8801 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: cbfe8395-a1da-4ff2-8951-0ffeaf568bae] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:03.305976 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-899387f0-fed0-4fd9-bd91-eefd007b8801 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:03.307249 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-899387f0-fed0-4fd9-bd91-eefd007b8801 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:03.308318 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-899387f0-fed0-4fd9-bd91-eefd007b8801 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:03.309958 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-899387f0-fed0-4fd9-bd91-eefd007b8801 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:03.311305 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-c86fcd21-a018-4fe9-a7ed-9556e35738a6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:03.311687 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-899387f0-fed0-4fd9-bd91-eefd007b8801 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:03.312648 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-c86fcd21-a018-4fe9-a7ed-9556e35738a6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: f634aa6d-e24c-48df-946f-3166fd76273a] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:03.313275 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-899387f0-fed0-4fd9-bd91-eefd007b8801 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:03.332072 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c86fcd21-a018-4fe9-a7ed-9556e35738a6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:03.332983 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c86fcd21-a018-4fe9-a7ed-9556e35738a6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:03.334045 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c86fcd21-a018-4fe9-a7ed-9556e35738a6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:03.335243 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c86fcd21-a018-4fe9-a7ed-9556e35738a6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:03.336049 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c86fcd21-a018-4fe9-a7ed-9556e35738a6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:03.336771 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c86fcd21-a018-4fe9-a7ed-9556e35738a6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:03.641107 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c86fcd21-a018-4fe9-a7ed-9556e35738a6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:03.649512 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-c86fcd21-a018-4fe9-a7ed-9556e35738a6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a" status: 200 len: 1510 microversion: 2.1 time: 0.347281 Sep 16 09:53:03.652352 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-899387f0-fed0-4fd9-bd91-eefd007b8801 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:03.663317 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-899387f0-fed0-4fd9-bd91-eefd007b8801 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/cbfe8395-a1da-4ff2-8951-0ffeaf568bae" status: 200 len: 1314 microversion: 2.1 time: 0.380818 Sep 16 09:53:03.664660 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 158/309] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:03 2022] GET /compute/v2.1/servers/cbfe8395-a1da-4ff2-8951-0ffeaf568bae => generated 1314 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:03.666669 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 152/310] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:03 2022] GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a => generated 1510 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:53:03.670279 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-82e60050-a465-4a07-9791-cc60de1e2900 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:03.671437 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-82e60050-a465-4a07-9791-cc60de1e2900 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 33e0e447-38a7-474d-ae32-1941ee3260c6] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:03.679109 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-82e60050-a465-4a07-9791-cc60de1e2900 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:03.679817 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-82e60050-a465-4a07-9791-cc60de1e2900 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:03.680461 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-82e60050-a465-4a07-9791-cc60de1e2900 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:03.681158 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-82e60050-a465-4a07-9791-cc60de1e2900 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:03.681651 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-82e60050-a465-4a07-9791-cc60de1e2900 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:03.682063 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-82e60050-a465-4a07-9791-cc60de1e2900 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:03.862088 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-82e60050-a465-4a07-9791-cc60de1e2900 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:03.872652 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-82e60050-a465-4a07-9791-cc60de1e2900 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6" status: 200 len: 1367 microversion: 2.1 time: 0.206530 Sep 16 09:53:03.874487 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 159/311] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:03 2022] GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6 => generated 1367 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:03.954380 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-8ce9379b-611c-47d9-abc3-c59b7e8b56ee tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:03.955634 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-8ce9379b-611c-47d9-abc3-c59b7e8b56ee tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:03.964437 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8ce9379b-611c-47d9-abc3-c59b7e8b56ee tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:03.967172 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8ce9379b-611c-47d9-abc3-c59b7e8b56ee tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:03.967846 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8ce9379b-611c-47d9-abc3-c59b7e8b56ee tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:03.980490 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8ce9379b-611c-47d9-abc3-c59b7e8b56ee tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:03.981983 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8ce9379b-611c-47d9-abc3-c59b7e8b56ee tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:03.982942 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8ce9379b-611c-47d9-abc3-c59b7e8b56ee tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:04.400245 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-8ce9379b-611c-47d9-abc3-c59b7e8b56ee tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:04.400245 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-8ce9379b-611c-47d9-abc3-c59b7e8b56ee tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:04.401453 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-8ce9379b-611c-47d9-abc3-c59b7e8b56ee tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:04.401453 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-8ce9379b-611c-47d9-abc3-c59b7e8b56ee tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1735 microversion: 2.20 time: 0.360975 Sep 16 09:53:04.401453 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 153/312] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:53:03 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1735 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:53:04.676607 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-b55b0861-dae5-44fc-ae8c-4b81b3820412 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:04.677967 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-b55b0861-dae5-44fc-ae8c-4b81b3820412 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: f634aa6d-e24c-48df-946f-3166fd76273a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:04.688667 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b55b0861-dae5-44fc-ae8c-4b81b3820412 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:04.691867 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b55b0861-dae5-44fc-ae8c-4b81b3820412 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:04.693961 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-fda1254a-5b60-40ac-ac70-f8c7a3da913d tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:04.695010 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-fda1254a-5b60-40ac-ac70-f8c7a3da913d tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: cbfe8395-a1da-4ff2-8951-0ffeaf568bae] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:04.695148 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b55b0861-dae5-44fc-ae8c-4b81b3820412 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:04.695951 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b55b0861-dae5-44fc-ae8c-4b81b3820412 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:04.696567 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b55b0861-dae5-44fc-ae8c-4b81b3820412 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:04.697555 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b55b0861-dae5-44fc-ae8c-4b81b3820412 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:04.704079 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fda1254a-5b60-40ac-ac70-f8c7a3da913d tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:04.707348 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fda1254a-5b60-40ac-ac70-f8c7a3da913d tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:04.707348 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fda1254a-5b60-40ac-ac70-f8c7a3da913d tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:04.707348 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fda1254a-5b60-40ac-ac70-f8c7a3da913d tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:04.707348 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fda1254a-5b60-40ac-ac70-f8c7a3da913d tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:04.708252 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fda1254a-5b60-40ac-ac70-f8c7a3da913d tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:05.015949 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-b55b0861-dae5-44fc-ae8c-4b81b3820412 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:05.025856 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-b55b0861-dae5-44fc-ae8c-4b81b3820412 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a" status: 200 len: 1510 microversion: 2.1 time: 0.354097 Sep 16 09:53:05.029389 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 160/313] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:04 2022] GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a => generated 1510 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:05.047077 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-b1ccedbe-898a-4a18-9810-324acdaebfac tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:05.048093 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-b1ccedbe-898a-4a18-9810-324acdaebfac tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 33e0e447-38a7-474d-ae32-1941ee3260c6] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:05.054932 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b1ccedbe-898a-4a18-9810-324acdaebfac tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:05.055870 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b1ccedbe-898a-4a18-9810-324acdaebfac tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:05.056614 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b1ccedbe-898a-4a18-9810-324acdaebfac tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:05.057652 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b1ccedbe-898a-4a18-9810-324acdaebfac tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:05.058348 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b1ccedbe-898a-4a18-9810-324acdaebfac tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:05.058859 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b1ccedbe-898a-4a18-9810-324acdaebfac tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:05.279137 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-b1ccedbe-898a-4a18-9810-324acdaebfac tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:05.306665 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-b1ccedbe-898a-4a18-9810-324acdaebfac tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6" status: 200 len: 1367 microversion: 2.1 time: 0.275332 Sep 16 09:53:05.309074 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 161/314] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:05 2022] GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6 => generated 1367 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:05.315199 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-fda1254a-5b60-40ac-ac70-f8c7a3da913d tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:05.326782 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:53:05.335058 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-fda1254a-5b60-40ac-ac70-f8c7a3da913d tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/cbfe8395-a1da-4ff2-8951-0ffeaf568bae" status: 200 len: 1314 microversion: 2.1 time: 0.645856 Sep 16 09:53:05.336516 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [req-751cf9be-1c6d-4cf7-9147-7992e4516aed req-0c57945d-b18a-47ea-b05f-e4de11c7687c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbfe8395-a1da-4ff2-8951-0ffeaf568bae", "name": "network-vif-plugged", "status": "completed", "tag": "a3098220-05f9-42ce-a47c-128a2ad67619"}]} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:53:05.338104 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 154/315] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:04 2022] GET /compute/v2.1/servers/cbfe8395-a1da-4ff2-8951-0ffeaf568bae => generated 1314 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:53:05.356369 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-751cf9be-1c6d-4cf7-9147-7992e4516aed req-0c57945d-b18a-47ea-b05f-e4de11c7687c service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:05.357436 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-751cf9be-1c6d-4cf7-9147-7992e4516aed req-0c57945d-b18a-47ea-b05f-e4de11c7687c service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:05.360376 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-751cf9be-1c6d-4cf7-9147-7992e4516aed req-0c57945d-b18a-47ea-b05f-e4de11c7687c service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:05.380905 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.compute.server_external_events [req-751cf9be-1c6d-4cf7-9147-7992e4516aed req-0c57945d-b18a-47ea-b05f-e4de11c7687c service nova] Creating event network-vif-plugged:a3098220-05f9-42ce-a47c-128a2ad67619 for instance cbfe8395-a1da-4ff2-8951-0ffeaf568bae on hv-cinder-79053 Sep 16 09:53:05.390612 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [req-751cf9be-1c6d-4cf7-9147-7992e4516aed req-0c57945d-b18a-47ea-b05f-e4de11c7687c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067622 Sep 16 09:53:05.394119 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 162/316] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:53:05.406671 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-5d5b203e-57e8-4b57-bf37-339e019e5972 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:05.407378 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-5d5b203e-57e8-4b57-bf37-339e019e5972 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:05.419225 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5d5b203e-57e8-4b57-bf37-339e019e5972 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:05.421382 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5d5b203e-57e8-4b57-bf37-339e019e5972 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:05.421921 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5d5b203e-57e8-4b57-bf37-339e019e5972 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:05.424787 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5d5b203e-57e8-4b57-bf37-339e019e5972 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:05.425303 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5d5b203e-57e8-4b57-bf37-339e019e5972 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:05.426934 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5d5b203e-57e8-4b57-bf37-339e019e5972 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:05.676290 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-5d5b203e-57e8-4b57-bf37-339e019e5972 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:05.697485 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-5d5b203e-57e8-4b57-bf37-339e019e5972 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:05.722957 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-5d5b203e-57e8-4b57-bf37-339e019e5972 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:05.722957 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-5d5b203e-57e8-4b57-bf37-339e019e5972 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1735 microversion: 2.20 time: 0.302490 Sep 16 09:53:05.722957 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 155/317] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:53:05 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1735 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 09:53:06.056103 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-af9c4e2f-66c2-4f44-bb49-79a7ecba1340 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:06.057429 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-af9c4e2f-66c2-4f44-bb49-79a7ecba1340 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: f634aa6d-e24c-48df-946f-3166fd76273a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:06.066825 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-af9c4e2f-66c2-4f44-bb49-79a7ecba1340 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:06.075992 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-af9c4e2f-66c2-4f44-bb49-79a7ecba1340 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:06.076472 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-af9c4e2f-66c2-4f44-bb49-79a7ecba1340 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:06.077238 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-af9c4e2f-66c2-4f44-bb49-79a7ecba1340 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:06.077742 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-af9c4e2f-66c2-4f44-bb49-79a7ecba1340 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:06.078238 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-af9c4e2f-66c2-4f44-bb49-79a7ecba1340 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:06.101126 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell1:SELECT=100 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:53:06.286945 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-af9c4e2f-66c2-4f44-bb49-79a7ecba1340 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:06.296979 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-af9c4e2f-66c2-4f44-bb49-79a7ecba1340 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a" status: 200 len: 1510 microversion: 2.1 time: 0.246193 Sep 16 09:53:06.297789 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 163/318] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:06 2022] GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a => generated 1510 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:06.334820 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-a051fb70-854e-4988-9159-7115373d2033 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:06.336002 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-a051fb70-854e-4988-9159-7115373d2033 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 33e0e447-38a7-474d-ae32-1941ee3260c6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:06.345153 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a051fb70-854e-4988-9159-7115373d2033 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:06.346729 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a051fb70-854e-4988-9159-7115373d2033 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:06.348240 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a051fb70-854e-4988-9159-7115373d2033 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:06.349060 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a051fb70-854e-4988-9159-7115373d2033 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:06.349528 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a051fb70-854e-4988-9159-7115373d2033 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:06.349989 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a051fb70-854e-4988-9159-7115373d2033 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:06.367951 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-8f120cf0-6191-4d1d-afae-1ab4cabe066a tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:06.369802 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-8f120cf0-6191-4d1d-afae-1ab4cabe066a tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: cbfe8395-a1da-4ff2-8951-0ffeaf568bae] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:06.379753 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8f120cf0-6191-4d1d-afae-1ab4cabe066a tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:06.380803 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8f120cf0-6191-4d1d-afae-1ab4cabe066a tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:06.381625 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8f120cf0-6191-4d1d-afae-1ab4cabe066a tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:06.382538 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8f120cf0-6191-4d1d-afae-1ab4cabe066a tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:06.383307 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8f120cf0-6191-4d1d-afae-1ab4cabe066a tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:06.383978 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8f120cf0-6191-4d1d-afae-1ab4cabe066a tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:06.637963 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-8f120cf0-6191-4d1d-afae-1ab4cabe066a tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:06.646050 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-a051fb70-854e-4988-9159-7115373d2033 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:06.650705 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-8f120cf0-6191-4d1d-afae-1ab4cabe066a tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/cbfe8395-a1da-4ff2-8951-0ffeaf568bae" status: 200 len: 1314 microversion: 2.1 time: 0.289658 Sep 16 09:53:06.651497 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 164/319] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:06 2022] GET /compute/v2.1/servers/cbfe8395-a1da-4ff2-8951-0ffeaf568bae => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:06.666056 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-a051fb70-854e-4988-9159-7115373d2033 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6" status: 200 len: 1367 microversion: 2.1 time: 0.336533 Sep 16 09:53:06.666999 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 156/320] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:06 2022] GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6 => generated 1367 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:06.742095 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-e9ce33a0-4ac1-4230-94ef-4e69ac24d3a1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:06.742977 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-e9ce33a0-4ac1-4230-94ef-4e69ac24d3a1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:06.757999 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e9ce33a0-4ac1-4230-94ef-4e69ac24d3a1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:06.758751 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e9ce33a0-4ac1-4230-94ef-4e69ac24d3a1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:06.759438 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e9ce33a0-4ac1-4230-94ef-4e69ac24d3a1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:06.763504 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e9ce33a0-4ac1-4230-94ef-4e69ac24d3a1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:06.773830 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e9ce33a0-4ac1-4230-94ef-4e69ac24d3a1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:06.774612 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e9ce33a0-4ac1-4230-94ef-4e69ac24d3a1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:07.077147 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-e9ce33a0-4ac1-4230-94ef-4e69ac24d3a1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:07.101407 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-e9ce33a0-4ac1-4230-94ef-4e69ac24d3a1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:07.104710 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-e9ce33a0-4ac1-4230-94ef-4e69ac24d3a1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:07.107163 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-e9ce33a0-4ac1-4230-94ef-4e69ac24d3a1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1735 microversion: 2.20 time: 0.370967 Sep 16 09:53:07.132125 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 165/321] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:53:06 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1735 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:53:07.320600 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-7cf0821b-c3c0-4d1e-8143-59e985e20b19 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:07.321265 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-7cf0821b-c3c0-4d1e-8143-59e985e20b19 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: f634aa6d-e24c-48df-946f-3166fd76273a] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:07.354252 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7cf0821b-c3c0-4d1e-8143-59e985e20b19 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:07.354878 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7cf0821b-c3c0-4d1e-8143-59e985e20b19 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:07.355508 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7cf0821b-c3c0-4d1e-8143-59e985e20b19 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:07.356412 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7cf0821b-c3c0-4d1e-8143-59e985e20b19 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:07.356879 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7cf0821b-c3c0-4d1e-8143-59e985e20b19 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:07.357316 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7cf0821b-c3c0-4d1e-8143-59e985e20b19 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:07.419095 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [req-f63de06a-0d80-497f-b66d-21e8ebc12e31 req-c96644b3-0b5d-4734-859e-5673e9a88560 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33e0e447-38a7-474d-ae32-1941ee3260c6", "name": "network-vif-plugged", "status": "completed", "tag": "4108db2f-5c49-4ad6-ae61-afd84b76a0ce"}]} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:53:07.447927 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-f63de06a-0d80-497f-b66d-21e8ebc12e31 req-c96644b3-0b5d-4734-859e-5673e9a88560 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:07.448674 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-f63de06a-0d80-497f-b66d-21e8ebc12e31 req-c96644b3-0b5d-4734-859e-5673e9a88560 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:07.449289 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-f63de06a-0d80-497f-b66d-21e8ebc12e31 req-c96644b3-0b5d-4734-859e-5673e9a88560 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:07.464079 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.compute.server_external_events [req-f63de06a-0d80-497f-b66d-21e8ebc12e31 req-c96644b3-0b5d-4734-859e-5673e9a88560 service nova] Creating event network-vif-plugged:4108db2f-5c49-4ad6-ae61-afd84b76a0ce for instance 33e0e447-38a7-474d-ae32-1941ee3260c6 on hv-cinder-79053 Sep 16 09:53:07.470806 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [req-f63de06a-0d80-497f-b66d-21e8ebc12e31 req-c96644b3-0b5d-4734-859e-5673e9a88560 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055000 Sep 16 09:53:07.475196 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 166/322] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:53:07.606568 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-7cf0821b-c3c0-4d1e-8143-59e985e20b19 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:07.622312 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-7cf0821b-c3c0-4d1e-8143-59e985e20b19 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a" status: 200 len: 1516 microversion: 2.1 time: 0.305335 Sep 16 09:53:07.623445 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 157/323] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:07 2022] GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a => generated 1516 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:07.683386 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-e2138100-eec9-4db0-a51e-7cdbf693012c tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:07.684183 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-e2138100-eec9-4db0-a51e-7cdbf693012c tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: cbfe8395-a1da-4ff2-8951-0ffeaf568bae] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:07.703360 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-795ba0d4-8859-44ed-9f06-340d282dcf52 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:07.712138 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e2138100-eec9-4db0-a51e-7cdbf693012c tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:07.712138 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e2138100-eec9-4db0-a51e-7cdbf693012c tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:07.712138 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e2138100-eec9-4db0-a51e-7cdbf693012c tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:07.713043 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e2138100-eec9-4db0-a51e-7cdbf693012c tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:07.723194 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-795ba0d4-8859-44ed-9f06-340d282dcf52 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 33e0e447-38a7-474d-ae32-1941ee3260c6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:07.724274 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e2138100-eec9-4db0-a51e-7cdbf693012c tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:07.726126 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e2138100-eec9-4db0-a51e-7cdbf693012c tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:07.738772 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-795ba0d4-8859-44ed-9f06-340d282dcf52 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:07.739713 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-795ba0d4-8859-44ed-9f06-340d282dcf52 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:07.740473 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-795ba0d4-8859-44ed-9f06-340d282dcf52 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:07.741586 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-795ba0d4-8859-44ed-9f06-340d282dcf52 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:07.755967 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-795ba0d4-8859-44ed-9f06-340d282dcf52 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:07.770437 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-795ba0d4-8859-44ed-9f06-340d282dcf52 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:07.994781 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-e2138100-eec9-4db0-a51e-7cdbf693012c tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:07.995670 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-795ba0d4-8859-44ed-9f06-340d282dcf52 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:08.005112 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-795ba0d4-8859-44ed-9f06-340d282dcf52 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6" status: 200 len: 1367 microversion: 2.1 time: 0.315817 Sep 16 09:53:08.006076 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 158/324] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:07 2022] GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6 => generated 1367 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:08.007360 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-e2138100-eec9-4db0-a51e-7cdbf693012c tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/cbfe8395-a1da-4ff2-8951-0ffeaf568bae" status: 200 len: 1314 microversion: 2.1 time: 0.336899 Sep 16 09:53:08.008154 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 167/325] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:07 2022] GET /compute/v2.1/servers/cbfe8395-a1da-4ff2-8951-0ffeaf568bae => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:08.139882 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-2a6dc848-848f-4752-81e5-af06a25c22d1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:08.140565 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-2a6dc848-848f-4752-81e5-af06a25c22d1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:08.147753 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2a6dc848-848f-4752-81e5-af06a25c22d1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:08.148242 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2a6dc848-848f-4752-81e5-af06a25c22d1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:08.148687 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2a6dc848-848f-4752-81e5-af06a25c22d1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:08.149391 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2a6dc848-848f-4752-81e5-af06a25c22d1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:08.149887 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2a6dc848-848f-4752-81e5-af06a25c22d1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:08.150319 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2a6dc848-848f-4752-81e5-af06a25c22d1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:08.310521 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-2a6dc848-848f-4752-81e5-af06a25c22d1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:08.319348 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-2a6dc848-848f-4752-81e5-af06a25c22d1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:08.320798 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-2a6dc848-848f-4752-81e5-af06a25c22d1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:08.322270 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-2a6dc848-848f-4752-81e5-af06a25c22d1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1735 microversion: 2.20 time: 0.186326 Sep 16 09:53:08.323546 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 159/326] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:53:08 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1735 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:53:09.031754 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-336d1583-0809-49cf-a45b-0aefa709020c tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:09.036165 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-336d1583-0809-49cf-a45b-0aefa709020c tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: cbfe8395-a1da-4ff2-8951-0ffeaf568bae] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:09.044497 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-fd3d5ad3-a9c3-4276-92ee-bf195e863331 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:09.045126 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-fd3d5ad3-a9c3-4276-92ee-bf195e863331 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 33e0e447-38a7-474d-ae32-1941ee3260c6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:09.045243 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-336d1583-0809-49cf-a45b-0aefa709020c tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:09.045956 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-336d1583-0809-49cf-a45b-0aefa709020c tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:09.047028 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-336d1583-0809-49cf-a45b-0aefa709020c tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:09.047886 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-336d1583-0809-49cf-a45b-0aefa709020c tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:09.049450 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-336d1583-0809-49cf-a45b-0aefa709020c tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:09.050054 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-336d1583-0809-49cf-a45b-0aefa709020c tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:09.073707 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fd3d5ad3-a9c3-4276-92ee-bf195e863331 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:09.074251 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fd3d5ad3-a9c3-4276-92ee-bf195e863331 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:09.082488 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fd3d5ad3-a9c3-4276-92ee-bf195e863331 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:09.083676 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fd3d5ad3-a9c3-4276-92ee-bf195e863331 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:09.085621 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fd3d5ad3-a9c3-4276-92ee-bf195e863331 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:09.086881 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fd3d5ad3-a9c3-4276-92ee-bf195e863331 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:09.335529 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-fd3d5ad3-a9c3-4276-92ee-bf195e863331 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:09.349403 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-336d1583-0809-49cf-a45b-0aefa709020c tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:09.349947 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-fd3d5ad3-a9c3-4276-92ee-bf195e863331 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6" status: 200 len: 1367 microversion: 2.1 time: 0.312874 Sep 16 09:53:09.350973 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 160/327] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:09 2022] GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6 => generated 1367 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:09.360642 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-336d1583-0809-49cf-a45b-0aefa709020c tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/cbfe8395-a1da-4ff2-8951-0ffeaf568bae" status: 200 len: 1498 microversion: 2.1 time: 0.333563 Sep 16 09:53:09.362139 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-9097c02c-8ae2-4d10-8efc-20dbc8530f5e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:09.363896 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-9097c02c-8ae2-4d10-8efc-20dbc8530f5e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:09.377982 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 168/328] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:09 2022] GET /compute/v2.1/servers/cbfe8395-a1da-4ff2-8951-0ffeaf568bae => generated 1498 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:09.408947 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9097c02c-8ae2-4d10-8efc-20dbc8530f5e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:09.409917 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9097c02c-8ae2-4d10-8efc-20dbc8530f5e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:09.410374 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9097c02c-8ae2-4d10-8efc-20dbc8530f5e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:09.411115 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9097c02c-8ae2-4d10-8efc-20dbc8530f5e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:09.414801 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9097c02c-8ae2-4d10-8efc-20dbc8530f5e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:09.418440 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9097c02c-8ae2-4d10-8efc-20dbc8530f5e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:09.650691 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-9097c02c-8ae2-4d10-8efc-20dbc8530f5e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:09.654667 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-9097c02c-8ae2-4d10-8efc-20dbc8530f5e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:09.656478 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-9097c02c-8ae2-4d10-8efc-20dbc8530f5e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:09.658690 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-9097c02c-8ae2-4d10-8efc-20dbc8530f5e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1735 microversion: 2.20 time: 0.305776 Sep 16 09:53:09.679014 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 161/329] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:53:09 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1735 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:53:10.011288 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-9a6bf27e-d7b0-4d0c-8d58-5e9ae493cd29 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Action: 'create', calling method: .version_select at 0x7ffa6ddce160>, body: {"keypair": {"name": "tempest-keypair-1170594007", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXZzw9vZploJZ5lVZFZPVcKsEo9udZ1j1D0QG0uJ+OmsSmhdXV92c5rEq+df2qCtweEFttzdecvg392rNOJXBZTK72eNp8nOodIk6FEltJivrld1Y0u61AfsDnCgqGrdw=="}} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:53:10.022405 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_api:SELECT=100 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:53:10.062953 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.quota [None req-9a6bf27e-d7b0-4d0c-8d58-5e9ae493cd29 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Getting quotas for project 3fe0d52d42324aa38182b47b3588b979. Resources: {'key_pairs'} {{(pid=127671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 09:53:10.070151 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.quota [None req-9a6bf27e-d7b0-4d0c-8d58-5e9ae493cd29 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Getting quotas for user 8d1ce0bdadbc48d2899c7cdded5acb5c and project 3fe0d52d42324aa38182b47b3588b979. Resources: {'key_pairs'} {{(pid=127671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 09:53:10.226793 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-9a6bf27e-d7b0-4d0c-8d58-5e9ae493cd29 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.230617 Sep 16 09:53:10.227442 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 169/330] 10.222.0.73 () {60 vars in 1159 bytes} [Fri Sep 16 09:53:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:53:10.379484 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-b2c523e5-dc4a-4ea3-b026-5381abb0aba9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:10.382633 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-b2c523e5-dc4a-4ea3-b026-5381abb0aba9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 33e0e447-38a7-474d-ae32-1941ee3260c6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:10.399444 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b2c523e5-dc4a-4ea3-b026-5381abb0aba9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:10.402265 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b2c523e5-dc4a-4ea3-b026-5381abb0aba9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:10.405308 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b2c523e5-dc4a-4ea3-b026-5381abb0aba9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:10.406291 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b2c523e5-dc4a-4ea3-b026-5381abb0aba9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:10.406981 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b2c523e5-dc4a-4ea3-b026-5381abb0aba9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:10.411039 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b2c523e5-dc4a-4ea3-b026-5381abb0aba9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:10.644991 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-b2c523e5-dc4a-4ea3-b026-5381abb0aba9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:10.654552 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-b2c523e5-dc4a-4ea3-b026-5381abb0aba9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6" status: 200 len: 1367 microversion: 2.1 time: 0.282039 Sep 16 09:53:10.655522 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 162/331] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:10 2022] GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6 => generated 1367 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:10.690641 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-bbee021d-ed74-4282-85f6-7a1013583cf9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:10.690641 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-bbee021d-ed74-4282-85f6-7a1013583cf9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:10.699125 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-bbee021d-ed74-4282-85f6-7a1013583cf9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:10.699627 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-bbee021d-ed74-4282-85f6-7a1013583cf9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:10.700070 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-bbee021d-ed74-4282-85f6-7a1013583cf9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:10.704111 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-bbee021d-ed74-4282-85f6-7a1013583cf9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:10.704579 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-bbee021d-ed74-4282-85f6-7a1013583cf9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:10.705026 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-bbee021d-ed74-4282-85f6-7a1013583cf9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:10.918086 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-bbee021d-ed74-4282-85f6-7a1013583cf9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:10.931125 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-bbee021d-ed74-4282-85f6-7a1013583cf9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:10.933239 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-bbee021d-ed74-4282-85f6-7a1013583cf9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:10.934697 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-bbee021d-ed74-4282-85f6-7a1013583cf9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1735 microversion: 2.20 time: 0.249796 Sep 16 09:53:10.935337 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 170/332] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:53:10 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1735 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:53:11.682774 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-8ddd9c09-0594-491e-aa42-70fb43bda5bc tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:11.682774 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-8ddd9c09-0594-491e-aa42-70fb43bda5bc tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 33e0e447-38a7-474d-ae32-1941ee3260c6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:11.689643 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8ddd9c09-0594-491e-aa42-70fb43bda5bc tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:11.691090 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8ddd9c09-0594-491e-aa42-70fb43bda5bc tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:11.691761 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8ddd9c09-0594-491e-aa42-70fb43bda5bc tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:11.692973 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8ddd9c09-0594-491e-aa42-70fb43bda5bc tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:11.693682 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8ddd9c09-0594-491e-aa42-70fb43bda5bc tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:11.694381 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8ddd9c09-0594-491e-aa42-70fb43bda5bc tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:11.903054 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-8ddd9c09-0594-491e-aa42-70fb43bda5bc tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:11.918151 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-8ddd9c09-0594-491e-aa42-70fb43bda5bc tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6" status: 200 len: 1367 microversion: 2.1 time: 0.242212 Sep 16 09:53:11.919325 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 163/333] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:11 2022] GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6 => generated 1367 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:11.961236 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-90c864fe-6748-472b-80e5-99ee27c9fd17 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:11.961865 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-90c864fe-6748-472b-80e5-99ee27c9fd17 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:11.970754 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-90c864fe-6748-472b-80e5-99ee27c9fd17 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:11.971376 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-90c864fe-6748-472b-80e5-99ee27c9fd17 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:11.971701 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-90c864fe-6748-472b-80e5-99ee27c9fd17 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:11.972625 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-90c864fe-6748-472b-80e5-99ee27c9fd17 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:11.973259 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-90c864fe-6748-472b-80e5-99ee27c9fd17 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:11.973886 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-90c864fe-6748-472b-80e5-99ee27c9fd17 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:12.257969 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-90c864fe-6748-472b-80e5-99ee27c9fd17 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:12.272900 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-90c864fe-6748-472b-80e5-99ee27c9fd17 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:12.276969 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-90c864fe-6748-472b-80e5-99ee27c9fd17 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:12.276969 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-90c864fe-6748-472b-80e5-99ee27c9fd17 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1735 microversion: 2.20 time: 0.319122 Sep 16 09:53:12.277722 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 171/334] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:53:11 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1735 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:53:12.947451 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-4581903c-b4fb-42f2-a638-545a97cf48c6 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:12.948292 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-4581903c-b4fb-42f2-a638-545a97cf48c6 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 33e0e447-38a7-474d-ae32-1941ee3260c6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:12.956866 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4581903c-b4fb-42f2-a638-545a97cf48c6 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:12.961802 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4581903c-b4fb-42f2-a638-545a97cf48c6 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:12.961802 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4581903c-b4fb-42f2-a638-545a97cf48c6 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:12.961802 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4581903c-b4fb-42f2-a638-545a97cf48c6 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:12.961802 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4581903c-b4fb-42f2-a638-545a97cf48c6 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:12.962851 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4581903c-b4fb-42f2-a638-545a97cf48c6 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:13.116771 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-4581903c-b4fb-42f2-a638-545a97cf48c6 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:13.124649 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-4581903c-b4fb-42f2-a638-545a97cf48c6 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6" status: 200 len: 1367 microversion: 2.1 time: 0.184540 Sep 16 09:53:13.125323 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 164/335] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:12 2022] GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6 => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:13.306993 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-03427c27-8691-449d-8d15-ca03f860ad8e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:13.307611 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-03427c27-8691-449d-8d15-ca03f860ad8e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:13.316535 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-03427c27-8691-449d-8d15-ca03f860ad8e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:13.317076 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-03427c27-8691-449d-8d15-ca03f860ad8e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:13.317918 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-03427c27-8691-449d-8d15-ca03f860ad8e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:13.318820 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-03427c27-8691-449d-8d15-ca03f860ad8e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:13.319294 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-03427c27-8691-449d-8d15-ca03f860ad8e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:13.319741 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-03427c27-8691-449d-8d15-ca03f860ad8e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:13.691635 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-03427c27-8691-449d-8d15-ca03f860ad8e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:13.703509 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-03427c27-8691-449d-8d15-ca03f860ad8e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:13.709759 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-03427c27-8691-449d-8d15-ca03f860ad8e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:13.711399 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-03427c27-8691-449d-8d15-ca03f860ad8e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1735 microversion: 2.20 time: 0.409320 Sep 16 09:53:13.713975 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 172/336] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:53:13 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1735 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:53:14.061678 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-abf3165f-0e61-4cc3-9961-2be2166eb692 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:14.062222 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-abf3165f-0e61-4cc3-9961-2be2166eb692 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: cbfe8395-a1da-4ff2-8951-0ffeaf568bae] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:14.072736 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-abf3165f-0e61-4cc3-9961-2be2166eb692 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:14.073265 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-abf3165f-0e61-4cc3-9961-2be2166eb692 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:14.073694 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-abf3165f-0e61-4cc3-9961-2be2166eb692 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:14.074449 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-abf3165f-0e61-4cc3-9961-2be2166eb692 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:14.075097 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-abf3165f-0e61-4cc3-9961-2be2166eb692 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:14.075533 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-abf3165f-0e61-4cc3-9961-2be2166eb692 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:14.107981 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-abf3165f-0e61-4cc3-9961-2be2166eb692 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: cbfe8395-a1da-4ff2-8951-0ffeaf568bae] Going to try to terminate instance {{(pid=127670) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 09:53:14.148361 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-b7f01d60-dc0f-4e75-849a-7ade08f3a2ca tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:14.149277 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-b7f01d60-dc0f-4e75-849a-7ade08f3a2ca tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 33e0e447-38a7-474d-ae32-1941ee3260c6] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:14.156268 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b7f01d60-dc0f-4e75-849a-7ade08f3a2ca tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:14.159710 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b7f01d60-dc0f-4e75-849a-7ade08f3a2ca tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:14.159710 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b7f01d60-dc0f-4e75-849a-7ade08f3a2ca tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:14.159710 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b7f01d60-dc0f-4e75-849a-7ade08f3a2ca tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:14.159710 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b7f01d60-dc0f-4e75-849a-7ade08f3a2ca tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:14.160128 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b7f01d60-dc0f-4e75-849a-7ade08f3a2ca tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:14.352256 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-b7f01d60-dc0f-4e75-849a-7ade08f3a2ca tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:14.360752 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-b7f01d60-dc0f-4e75-849a-7ade08f3a2ca tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6" status: 200 len: 1557 microversion: 2.1 time: 0.216164 Sep 16 09:53:14.361435 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 173/337] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:14 2022] GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6 => generated 1557 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:53:14.385382 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-3ae4858d-1ad1-442d-ace2-dee1d5fb71e3 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-480760838", "imageRef": "30d28050-ec9d-4227-9bb0-5247430f6177", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "17684eae-ad40-4ec5-9092-8a60e4e87e96"}], "security_groups": [{"name": "tempest-securitygroup--1210293645"}], "key_name": "tempest-keypair-1170594007", "user_data": "}} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:53:14.519077 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-abf3165f-0e61-4cc3-9961-2be2166eb692 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "DELETE /compute/v2.1/servers/cbfe8395-a1da-4ff2-8951-0ffeaf568bae" status: 204 len: 0 microversion: 2.1 time: 0.461729 Sep 16 09:53:14.519951 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 165/338] 10.222.0.73 () {58 vars in 1239 bytes} [Fri Sep 16 09:53:14 2022] DELETE /compute/v2.1/servers/cbfe8395-a1da-4ff2-8951-0ffeaf568bae => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 09:53:14.525496 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-a0327b9a-710d-4d40-9e52-286826aa8f4b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:14.526154 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-a0327b9a-710d-4d40-9e52-286826aa8f4b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 33e0e447-38a7-474d-ae32-1941ee3260c6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:14.533840 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a0327b9a-710d-4d40-9e52-286826aa8f4b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:14.534620 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a0327b9a-710d-4d40-9e52-286826aa8f4b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:14.535222 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a0327b9a-710d-4d40-9e52-286826aa8f4b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:14.536085 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a0327b9a-710d-4d40-9e52-286826aa8f4b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:14.536700 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a0327b9a-710d-4d40-9e52-286826aa8f4b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:14.537282 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a0327b9a-710d-4d40-9e52-286826aa8f4b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:14.545189 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.network.neutron [None req-3ae4858d-1ad1-442d-ace2-dee1d5fb71e3 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] validate_networks() for [('17684eae-ad40-4ec5-9092-8a60e4e87e96', None, None, None, None, None)] {{(pid=127671) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 09:53:14.682158 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-a0327b9a-710d-4d40-9e52-286826aa8f4b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.160938 Sep 16 09:53:14.682764 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 166/339] 10.222.0.73 () {58 vars in 1275 bytes} [Fri Sep 16 09:53:14 2022] GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6/os-interface => generated 284 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:53:14.688313 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-a350ee06-8ef7-47e6-b325-0cfa796303aa tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:14.689905 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-a350ee06-8ef7-47e6-b325-0cfa796303aa tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: cbfe8395-a1da-4ff2-8951-0ffeaf568bae] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:14.702678 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a350ee06-8ef7-47e6-b325-0cfa796303aa tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:14.706071 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a350ee06-8ef7-47e6-b325-0cfa796303aa tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:14.707051 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a350ee06-8ef7-47e6-b325-0cfa796303aa tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:14.712239 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a350ee06-8ef7-47e6-b325-0cfa796303aa tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:14.712966 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a350ee06-8ef7-47e6-b325-0cfa796303aa tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:14.714070 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a350ee06-8ef7-47e6-b325-0cfa796303aa tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:15.182326 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.virt.hardware [None req-3ae4858d-1ad1-442d-ace2-dee1d5fb71e3 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Flavor limits 0:0:0 {{(pid=127671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 09:53:15.182925 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.virt.hardware [None req-3ae4858d-1ad1-442d-ace2-dee1d5fb71e3 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Image limits 0:0:0 {{(pid=127671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 09:53:15.183485 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.virt.hardware [None req-3ae4858d-1ad1-442d-ace2-dee1d5fb71e3 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Flavor pref 0:0:0 {{(pid=127671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 09:53:15.183982 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.virt.hardware [None req-3ae4858d-1ad1-442d-ace2-dee1d5fb71e3 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Image pref 0:0:0 {{(pid=127671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 09:53:15.184479 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.virt.hardware [None req-3ae4858d-1ad1-442d-ace2-dee1d5fb71e3 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 09:53:15.225067 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3ae4858d-1ad1-442d-ace2-dee1d5fb71e3 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:15.225655 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3ae4858d-1ad1-442d-ace2-dee1d5fb71e3 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:15.226200 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3ae4858d-1ad1-442d-ace2-dee1d5fb71e3 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:15.226972 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3ae4858d-1ad1-442d-ace2-dee1d5fb71e3 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:15.227617 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3ae4858d-1ad1-442d-ace2-dee1d5fb71e3 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:15.228231 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3ae4858d-1ad1-442d-ace2-dee1d5fb71e3 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:15.271819 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.quota [None req-3ae4858d-1ad1-442d-ace2-dee1d5fb71e3 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Getting quotas for project 3fe0d52d42324aa38182b47b3588b979. Resources: {'instances', 'cores', 'ram'} {{(pid=127671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 09:53:15.279966 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.quota [None req-3ae4858d-1ad1-442d-ace2-dee1d5fb71e3 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Getting quotas for user 8d1ce0bdadbc48d2899c7cdded5acb5c and project 3fe0d52d42324aa38182b47b3588b979. Resources: {'instances', 'cores', 'ram'} {{(pid=127671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 09:53:15.324727 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-3ae4858d-1ad1-442d-ace2-dee1d5fb71e3 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Going to run 1 instances... {{(pid=127671) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 09:53:15.331374 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-3ae4858d-1ad1-442d-ace2-dee1d5fb71e3 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='30d28050-ec9d-4227-9bb0-5247430f6177',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 09:53:15.502917 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-3ae4858d-1ad1-442d-ace2-dee1d5fb71e3 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.128677 Sep 16 09:53:15.503945 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 174/340] 10.222.0.73 () {60 vars in 1147 bytes} [Fri Sep 16 09:53:14 2022] POST /compute/v2.1/servers => generated 409 bytes in 1133 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 09:53:15.513222 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-2c351997-21bc-412d-9816-98cdf1aff63f tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1267321125", "imageRef": "30d28050-ec9d-4227-9bb0-5247430f6177", "flavorRef": "452"}} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:53:15.540390 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-a350ee06-8ef7-47e6-b325-0cfa796303aa tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:15.552926 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-a350ee06-8ef7-47e6-b325-0cfa796303aa tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/cbfe8395-a1da-4ff2-8951-0ffeaf568bae" status: 200 len: 1504 microversion: 2.1 time: 0.868569 Sep 16 09:53:15.553912 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 167/341] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:14 2022] GET /compute/v2.1/servers/cbfe8395-a1da-4ff2-8951-0ffeaf568bae => generated 1504 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:15.563953 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-998aa259-c6de-4a1b-9f22-08c7add12dfb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:15.572100 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-998aa259-c6de-4a1b-9f22-08c7add12dfb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:15.590548 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-998aa259-c6de-4a1b-9f22-08c7add12dfb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:15.591058 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-998aa259-c6de-4a1b-9f22-08c7add12dfb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:15.591531 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-998aa259-c6de-4a1b-9f22-08c7add12dfb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:15.592278 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-998aa259-c6de-4a1b-9f22-08c7add12dfb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:15.592738 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-998aa259-c6de-4a1b-9f22-08c7add12dfb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:15.593163 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-998aa259-c6de-4a1b-9f22-08c7add12dfb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:15.636987 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.network.neutron [None req-2c351997-21bc-412d-9816-98cdf1aff63f tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] validate_networks() for None {{(pid=127671) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 09:53:16.011299 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-998aa259-c6de-4a1b-9f22-08c7add12dfb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:16.025886 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-998aa259-c6de-4a1b-9f22-08c7add12dfb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:16.029660 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-998aa259-c6de-4a1b-9f22-08c7add12dfb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:16.031743 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-998aa259-c6de-4a1b-9f22-08c7add12dfb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1735 microversion: 2.20 time: 0.474073 Sep 16 09:53:16.036145 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 168/342] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:53:15 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1735 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:53:16.049035 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d1c44b87-72e8-408f-9ac1-1f141b538ed7 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:16.051780 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-d1c44b87-72e8-408f-9ac1-1f141b538ed7 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:16.159428 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.virt.hardware [None req-2c351997-21bc-412d-9816-98cdf1aff63f tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Flavor limits 0:0:0 {{(pid=127671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 09:53:16.159869 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.virt.hardware [None req-2c351997-21bc-412d-9816-98cdf1aff63f tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Image limits 0:0:0 {{(pid=127671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 09:53:16.160448 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.virt.hardware [None req-2c351997-21bc-412d-9816-98cdf1aff63f tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Flavor pref 0:0:0 {{(pid=127671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 09:53:16.161100 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.virt.hardware [None req-2c351997-21bc-412d-9816-98cdf1aff63f tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Image pref 0:0:0 {{(pid=127671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 09:53:16.161790 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.virt.hardware [None req-2c351997-21bc-412d-9816-98cdf1aff63f tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 09:53:16.172718 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2c351997-21bc-412d-9816-98cdf1aff63f tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:16.174967 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2c351997-21bc-412d-9816-98cdf1aff63f tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:16.175646 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2c351997-21bc-412d-9816-98cdf1aff63f tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:16.177395 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2c351997-21bc-412d-9816-98cdf1aff63f tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:16.179460 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2c351997-21bc-412d-9816-98cdf1aff63f tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:16.180103 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2c351997-21bc-412d-9816-98cdf1aff63f tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:16.204411 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.quota [None req-2c351997-21bc-412d-9816-98cdf1aff63f tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Getting quotas for project 9ab67e77307d4b8f926244bc18308358. Resources: {'instances', 'cores', 'ram'} {{(pid=127671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 09:53:16.212633 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.quota [None req-2c351997-21bc-412d-9816-98cdf1aff63f tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Getting quotas for user fa5c42006d0b442cb41952e5af6354c8 and project 9ab67e77307d4b8f926244bc18308358. Resources: {'instances', 'cores', 'ram'} {{(pid=127671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 09:53:16.277640 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-d1c44b87-72e8-408f-9ac1-1f141b538ed7 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:16.289928 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-d1c44b87-72e8-408f-9ac1-1f141b538ed7 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa" status: 200 len: 1245 microversion: 2.1 time: 0.251117 Sep 16 09:53:16.296872 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 169/343] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:16 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa => generated 1245 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:16.298951 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-2c351997-21bc-412d-9816-98cdf1aff63f tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Going to run 1 instances... {{(pid=127671) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 09:53:16.306677 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-2c351997-21bc-412d-9816-98cdf1aff63f tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] [instance: 20bade93-24eb-4e9e-8851-b3ece7eb6fed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='30d28050-ec9d-4227-9bb0-5247430f6177',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 09:53:16.505842 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-2c351997-21bc-412d-9816-98cdf1aff63f tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.998611 Sep 16 09:53:16.513468 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 175/344] 10.222.0.73 () {60 vars in 1147 bytes} [Fri Sep 16 09:53:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1003 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 09:53:16.523161 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-774d7ec3-8067-4c54-9411-ddbf2a59dfa9 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:16.524348 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-774d7ec3-8067-4c54-9411-ddbf2a59dfa9 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] [instance: 20bade93-24eb-4e9e-8851-b3ece7eb6fed] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:16.583762 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-aaec5a4c-405e-4a6f-8efd-689a20fc10eb tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:16.584716 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-aaec5a4c-405e-4a6f-8efd-689a20fc10eb tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: cbfe8395-a1da-4ff2-8951-0ffeaf568bae] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:16.602526 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-aaec5a4c-405e-4a6f-8efd-689a20fc10eb tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:16.603719 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-aaec5a4c-405e-4a6f-8efd-689a20fc10eb tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:16.605418 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-aaec5a4c-405e-4a6f-8efd-689a20fc10eb tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:16.606439 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-aaec5a4c-405e-4a6f-8efd-689a20fc10eb tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:16.607147 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-aaec5a4c-405e-4a6f-8efd-689a20fc10eb tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:16.607798 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-aaec5a4c-405e-4a6f-8efd-689a20fc10eb tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:16.789293 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-774d7ec3-8067-4c54-9411-ddbf2a59dfa9 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5c42006d0b442cb41952e5af6354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab67e77307d4b8f926244bc18308358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:16.803697 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-774d7ec3-8067-4c54-9411-ddbf2a59dfa9 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] 10.222.0.73 "GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed" status: 200 len: 1215 microversion: 2.1 time: 0.284765 Sep 16 09:53:16.810376 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-aaec5a4c-405e-4a6f-8efd-689a20fc10eb tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:16.821443 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 170/345] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:16 2022] GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed => generated 1215 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:16.838741 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-aaec5a4c-405e-4a6f-8efd-689a20fc10eb tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/cbfe8395-a1da-4ff2-8951-0ffeaf568bae" status: 200 len: 1504 microversion: 2.1 time: 0.262296 Sep 16 09:53:16.843232 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 176/346] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:16 2022] GET /compute/v2.1/servers/cbfe8395-a1da-4ff2-8951-0ffeaf568bae => generated 1504 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:17.062040 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-816c4222-eb13-4a83-b58e-405f7361629b tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:17.062649 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-816c4222-eb13-4a83-b58e-405f7361629b tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:17.082128 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-816c4222-eb13-4a83-b58e-405f7361629b tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:17.083920 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-816c4222-eb13-4a83-b58e-405f7361629b tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:17.084149 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-816c4222-eb13-4a83-b58e-405f7361629b tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:17.085104 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-816c4222-eb13-4a83-b58e-405f7361629b tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:17.086308 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-816c4222-eb13-4a83-b58e-405f7361629b tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:17.086954 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-816c4222-eb13-4a83-b58e-405f7361629b tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:17.325981 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-fc967dc8-e7f5-455b-8fa9-ec6191a580df tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:17.326871 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-fc967dc8-e7f5-455b-8fa9-ec6191a580df tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:17.353019 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-fc967dc8-e7f5-455b-8fa9-ec6191a580df tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:17.355625 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-fc967dc8-e7f5-455b-8fa9-ec6191a580df tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:17.356350 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-fc967dc8-e7f5-455b-8fa9-ec6191a580df tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:17.357089 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-fc967dc8-e7f5-455b-8fa9-ec6191a580df tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:17.357739 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-fc967dc8-e7f5-455b-8fa9-ec6191a580df tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:17.358770 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-fc967dc8-e7f5-455b-8fa9-ec6191a580df tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:17.372763 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-816c4222-eb13-4a83-b58e-405f7361629b tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:17.405673 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-816c4222-eb13-4a83-b58e-405f7361629b tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:17.405673 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-816c4222-eb13-4a83-b58e-405f7361629b tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:17.413406 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-816c4222-eb13-4a83-b58e-405f7361629b tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1735 microversion: 2.20 time: 0.352233 Sep 16 09:53:17.433326 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 171/347] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:53:17 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1735 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:53:17.550404 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-fc967dc8-e7f5-455b-8fa9-ec6191a580df tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:17.562497 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-fc967dc8-e7f5-455b-8fa9-ec6191a580df tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa" status: 200 len: 1241 microversion: 2.1 time: 0.241076 Sep 16 09:53:17.563314 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 177/348] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:17 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa => generated 1241 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:53:17.586036 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-5fa9a6b8-696a-4de4-b60b-aff6cd5f88b5 req-1d4625ba-b139-4c5b-917a-f9568eea3d77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbfe8395-a1da-4ff2-8951-0ffeaf568bae", "name": "network-vif-deleted", "tag": "a3098220-05f9-42ce-a47c-128a2ad67619"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:53:17.597273 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-5fa9a6b8-696a-4de4-b60b-aff6cd5f88b5 req-1d4625ba-b139-4c5b-917a-f9568eea3d77 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:17.604842 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-5fa9a6b8-696a-4de4-b60b-aff6cd5f88b5 req-1d4625ba-b139-4c5b-917a-f9568eea3d77 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:17.604842 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-5fa9a6b8-696a-4de4-b60b-aff6cd5f88b5 req-1d4625ba-b139-4c5b-917a-f9568eea3d77 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:17.604842 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:53:17.613122 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-5fa9a6b8-696a-4de4-b60b-aff6cd5f88b5 req-1d4625ba-b139-4c5b-917a-f9568eea3d77 service nova] Creating event network-vif-deleted:a3098220-05f9-42ce-a47c-128a2ad67619 for instance cbfe8395-a1da-4ff2-8951-0ffeaf568bae on hv-cinder-79053 Sep 16 09:53:17.619905 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-5fa9a6b8-696a-4de4-b60b-aff6cd5f88b5 req-1d4625ba-b139-4c5b-917a-f9568eea3d77 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038769 Sep 16 09:53:17.620800 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 172/349] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:53:17.843277 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-ed6ab81f-051c-4052-970b-9b55f31d5290 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:17.843916 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-ed6ab81f-051c-4052-970b-9b55f31d5290 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] [instance: 20bade93-24eb-4e9e-8851-b3ece7eb6fed] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:17.884373 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-08f1abc6-f40d-4a3a-9576-70adac5f102e tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:17.886555 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-08f1abc6-f40d-4a3a-9576-70adac5f102e tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: cbfe8395-a1da-4ff2-8951-0ffeaf568bae] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:17.896864 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-08f1abc6-f40d-4a3a-9576-70adac5f102e tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:17.897839 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-08f1abc6-f40d-4a3a-9576-70adac5f102e tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:17.898427 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-08f1abc6-f40d-4a3a-9576-70adac5f102e tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:17.899349 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-08f1abc6-f40d-4a3a-9576-70adac5f102e tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:17.900105 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-08f1abc6-f40d-4a3a-9576-70adac5f102e tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:17.900783 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-08f1abc6-f40d-4a3a-9576-70adac5f102e tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:17.921261 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-ed6ab81f-051c-4052-970b-9b55f31d5290 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5c42006d0b442cb41952e5af6354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab67e77307d4b8f926244bc18308358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:17.932051 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-ed6ab81f-051c-4052-970b-9b55f31d5290 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] 10.222.0.73 "GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed" status: 200 len: 1215 microversion: 2.1 time: 0.090163 Sep 16 09:53:17.932929 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 178/350] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:17 2022] GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed => generated 1215 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:17.985078 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-08f1abc6-f40d-4a3a-9576-70adac5f102e tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:17.997617 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-08f1abc6-f40d-4a3a-9576-70adac5f102e tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/cbfe8395-a1da-4ff2-8951-0ffeaf568bae" status: 200 len: 1462 microversion: 2.1 time: 0.133278 Sep 16 09:53:17.998525 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 173/351] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:17 2022] GET /compute/v2.1/servers/cbfe8395-a1da-4ff2-8951-0ffeaf568bae => generated 1462 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:18.445438 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-d939431e-2606-4cee-96c2-7d66c2e6d2e8 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:18.449956 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-d939431e-2606-4cee-96c2-7d66c2e6d2e8 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:18.501576 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d939431e-2606-4cee-96c2-7d66c2e6d2e8 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:18.503008 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d939431e-2606-4cee-96c2-7d66c2e6d2e8 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:18.503648 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d939431e-2606-4cee-96c2-7d66c2e6d2e8 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:18.505639 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d939431e-2606-4cee-96c2-7d66c2e6d2e8 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:18.507073 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d939431e-2606-4cee-96c2-7d66c2e6d2e8 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:18.508147 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d939431e-2606-4cee-96c2-7d66c2e6d2e8 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:18.588857 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-c90cf504-f4de-4ae0-b504-5598cd677e01 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:18.589918 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-c90cf504-f4de-4ae0-b504-5598cd677e01 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:18.614132 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c90cf504-f4de-4ae0-b504-5598cd677e01 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:18.614132 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c90cf504-f4de-4ae0-b504-5598cd677e01 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:18.614132 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c90cf504-f4de-4ae0-b504-5598cd677e01 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:18.614132 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c90cf504-f4de-4ae0-b504-5598cd677e01 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:18.615779 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c90cf504-f4de-4ae0-b504-5598cd677e01 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:18.615779 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c90cf504-f4de-4ae0-b504-5598cd677e01 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:18.769355 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c90cf504-f4de-4ae0-b504-5598cd677e01 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:18.794442 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-c90cf504-f4de-4ae0-b504-5598cd677e01 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa" status: 200 len: 1297 microversion: 2.1 time: 0.210901 Sep 16 09:53:18.796996 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 174/352] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:18 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa => generated 1297 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:18.877815 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-d939431e-2606-4cee-96c2-7d66c2e6d2e8 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:18.890685 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-d939431e-2606-4cee-96c2-7d66c2e6d2e8 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:18.893417 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-d939431e-2606-4cee-96c2-7d66c2e6d2e8 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:18.894871 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-d939431e-2606-4cee-96c2-7d66c2e6d2e8 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1735 microversion: 2.20 time: 0.458757 Sep 16 09:53:18.915762 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 179/353] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:53:18 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1735 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:53:18.959978 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-0eead391-93a1-46b0-b7d4-fec0600db19c tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:18.961262 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-0eead391-93a1-46b0-b7d4-fec0600db19c tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] [instance: 20bade93-24eb-4e9e-8851-b3ece7eb6fed] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:18.969842 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0eead391-93a1-46b0-b7d4-fec0600db19c tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:18.973696 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0eead391-93a1-46b0-b7d4-fec0600db19c tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:18.974465 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0eead391-93a1-46b0-b7d4-fec0600db19c tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:18.977701 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0eead391-93a1-46b0-b7d4-fec0600db19c tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:18.977701 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0eead391-93a1-46b0-b7d4-fec0600db19c tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:18.978405 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0eead391-93a1-46b0-b7d4-fec0600db19c tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:19.029433 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-f4bf9f09-ec9c-4186-afc1-79ea1f5ff216 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:19.030444 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-f4bf9f09-ec9c-4186-afc1-79ea1f5ff216 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: cbfe8395-a1da-4ff2-8951-0ffeaf568bae] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:19.046895 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f4bf9f09-ec9c-4186-afc1-79ea1f5ff216 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:19.046895 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f4bf9f09-ec9c-4186-afc1-79ea1f5ff216 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:19.046895 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f4bf9f09-ec9c-4186-afc1-79ea1f5ff216 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:19.048567 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f4bf9f09-ec9c-4186-afc1-79ea1f5ff216 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:19.049452 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f4bf9f09-ec9c-4186-afc1-79ea1f5ff216 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:19.051564 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f4bf9f09-ec9c-4186-afc1-79ea1f5ff216 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:19.107727 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f4bf9f09-ec9c-4186-afc1-79ea1f5ff216 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:19.108473 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f4bf9f09-ec9c-4186-afc1-79ea1f5ff216 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:19.109136 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f4bf9f09-ec9c-4186-afc1-79ea1f5ff216 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:19.109876 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.objects.instance [None req-f4bf9f09-ec9c-4186-afc1-79ea1f5ff216 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lazy-loading 'fault' on Instance uuid cbfe8395-a1da-4ff2-8951-0ffeaf568bae {{(pid=127671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 09:53:19.128684 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-0eead391-93a1-46b0-b7d4-fec0600db19c tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5c42006d0b442cb41952e5af6354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab67e77307d4b8f926244bc18308358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:19.150584 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-0eead391-93a1-46b0-b7d4-fec0600db19c tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] 10.222.0.73 "GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed" status: 200 len: 1219 microversion: 2.1 time: 0.197710 Sep 16 09:53:19.153140 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 175/354] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:18 2022] GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed => generated 1219 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:19.175449 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-f4bf9f09-ec9c-4186-afc1-79ea1f5ff216 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:19.184838 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-f4bf9f09-ec9c-4186-afc1-79ea1f5ff216 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/cbfe8395-a1da-4ff2-8951-0ffeaf568bae" status: 200 len: 1304 microversion: 2.1 time: 0.167562 Sep 16 09:53:19.186223 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 180/355] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:19 2022] GET /compute/v2.1/servers/cbfe8395-a1da-4ff2-8951-0ffeaf568bae => generated 1304 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:19.639251 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-55fcb2f8-1f60-4015-b01f-c9c2e0d0a3f6 req-7835240f-d1f8-4120-b5d1-725f9dbdbcab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33e0e447-38a7-474d-ae32-1941ee3260c6", "tag": "4108db2f-5c49-4ad6-ae61-afd84b76a0ce"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:53:19.660663 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-55fcb2f8-1f60-4015-b01f-c9c2e0d0a3f6 req-7835240f-d1f8-4120-b5d1-725f9dbdbcab service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:19.661403 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-55fcb2f8-1f60-4015-b01f-c9c2e0d0a3f6 req-7835240f-d1f8-4120-b5d1-725f9dbdbcab service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:19.663177 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-55fcb2f8-1f60-4015-b01f-c9c2e0d0a3f6 req-7835240f-d1f8-4120-b5d1-725f9dbdbcab service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:19.690523 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-55fcb2f8-1f60-4015-b01f-c9c2e0d0a3f6 req-7835240f-d1f8-4120-b5d1-725f9dbdbcab service nova] Creating event network-changed:4108db2f-5c49-4ad6-ae61-afd84b76a0ce for instance 33e0e447-38a7-474d-ae32-1941ee3260c6 on hv-cinder-79053 Sep 16 09:53:19.700715 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-55fcb2f8-1f60-4015-b01f-c9c2e0d0a3f6 req-7835240f-d1f8-4120-b5d1-725f9dbdbcab service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065243 Sep 16 09:53:19.701668 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 176/356] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:53:19.820447 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-eb80756a-dd1b-4372-acd2-2c048a0a10b7 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:19.821705 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-eb80756a-dd1b-4372-acd2-2c048a0a10b7 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:19.830923 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-eb80756a-dd1b-4372-acd2-2c048a0a10b7 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:19.831434 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-eb80756a-dd1b-4372-acd2-2c048a0a10b7 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:19.832414 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-eb80756a-dd1b-4372-acd2-2c048a0a10b7 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:19.833593 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-eb80756a-dd1b-4372-acd2-2c048a0a10b7 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:19.834559 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-eb80756a-dd1b-4372-acd2-2c048a0a10b7 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:19.835239 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-eb80756a-dd1b-4372-acd2-2c048a0a10b7 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:19.911262 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-eb80756a-dd1b-4372-acd2-2c048a0a10b7 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:19.920621 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-eb80756a-dd1b-4372-acd2-2c048a0a10b7 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa" status: 200 len: 1297 microversion: 2.1 time: 0.104303 Sep 16 09:53:19.942049 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-5d9a06b0-6aa0-4320-81c2-dcbcf7a5e700 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:19.942049 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-5d9a06b0-6aa0-4320-81c2-dcbcf7a5e700 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:19.943283 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 181/357] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:19 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa => generated 1297 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:20.004777 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5d9a06b0-6aa0-4320-81c2-dcbcf7a5e700 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:20.005394 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5d9a06b0-6aa0-4320-81c2-dcbcf7a5e700 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:20.006817 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5d9a06b0-6aa0-4320-81c2-dcbcf7a5e700 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:20.007640 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5d9a06b0-6aa0-4320-81c2-dcbcf7a5e700 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:20.009102 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5d9a06b0-6aa0-4320-81c2-dcbcf7a5e700 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:20.009569 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5d9a06b0-6aa0-4320-81c2-dcbcf7a5e700 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:20.180625 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-cd7bbf66-dbde-4e64-bca1-6f2054a2c0f2 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:20.181680 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-cd7bbf66-dbde-4e64-bca1-6f2054a2c0f2 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] [instance: 20bade93-24eb-4e9e-8851-b3ece7eb6fed] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:20.182079 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-5d9a06b0-6aa0-4320-81c2-dcbcf7a5e700 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:20.188167 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-cd7bbf66-dbde-4e64-bca1-6f2054a2c0f2 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:20.189587 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-cd7bbf66-dbde-4e64-bca1-6f2054a2c0f2 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:20.190287 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-cd7bbf66-dbde-4e64-bca1-6f2054a2c0f2 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:20.191191 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-cd7bbf66-dbde-4e64-bca1-6f2054a2c0f2 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:20.191331 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-5d9a06b0-6aa0-4320-81c2-dcbcf7a5e700 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:20.192248 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-cd7bbf66-dbde-4e64-bca1-6f2054a2c0f2 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:20.192862 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-5d9a06b0-6aa0-4320-81c2-dcbcf7a5e700 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:20.193145 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-cd7bbf66-dbde-4e64-bca1-6f2054a2c0f2 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:20.194103 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-5d9a06b0-6aa0-4320-81c2-dcbcf7a5e700 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1735 microversion: 2.20 time: 0.271531 Sep 16 09:53:20.194685 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 177/358] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:53:19 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1735 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 09:53:20.219502 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-49bdb19d-ffde-4853-9bdb-e2b0777fd62d tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:20.220544 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-49bdb19d-ffde-4853-9bdb-e2b0777fd62d tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: cbfe8395-a1da-4ff2-8951-0ffeaf568bae] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:20.227672 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-49bdb19d-ffde-4853-9bdb-e2b0777fd62d tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:20.228361 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-49bdb19d-ffde-4853-9bdb-e2b0777fd62d tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:20.228949 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-49bdb19d-ffde-4853-9bdb-e2b0777fd62d tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:20.229856 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-49bdb19d-ffde-4853-9bdb-e2b0777fd62d tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:20.230533 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-49bdb19d-ffde-4853-9bdb-e2b0777fd62d tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:20.231144 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-49bdb19d-ffde-4853-9bdb-e2b0777fd62d tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:20.307086 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-49bdb19d-ffde-4853-9bdb-e2b0777fd62d tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:20.307969 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-49bdb19d-ffde-4853-9bdb-e2b0777fd62d tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:20.308483 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-49bdb19d-ffde-4853-9bdb-e2b0777fd62d tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:20.308957 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.objects.instance [None req-49bdb19d-ffde-4853-9bdb-e2b0777fd62d tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lazy-loading 'fault' on Instance uuid cbfe8395-a1da-4ff2-8951-0ffeaf568bae {{(pid=127670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 09:53:20.409819 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-cd7bbf66-dbde-4e64-bca1-6f2054a2c0f2 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5c42006d0b442cb41952e5af6354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab67e77307d4b8f926244bc18308358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:20.422196 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-cd7bbf66-dbde-4e64-bca1-6f2054a2c0f2 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] 10.222.0.73 "GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed" status: 200 len: 1211 microversion: 2.1 time: 0.245799 Sep 16 09:53:20.422823 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 182/359] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:20 2022] GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed => generated 1211 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:53:20.448625 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-49bdb19d-ffde-4853-9bdb-e2b0777fd62d tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:20.469688 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-49bdb19d-ffde-4853-9bdb-e2b0777fd62d tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/cbfe8395-a1da-4ff2-8951-0ffeaf568bae" status: 200 len: 1304 microversion: 2.1 time: 0.254066 Sep 16 09:53:20.472722 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 178/360] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:20 2022] GET /compute/v2.1/servers/cbfe8395-a1da-4ff2-8951-0ffeaf568bae => generated 1304 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:20.968801 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-ad620baa-7b6a-4fa2-9f96-7b54d476fd22 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:20.969457 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-ad620baa-7b6a-4fa2-9f96-7b54d476fd22 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:20.976800 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ad620baa-7b6a-4fa2-9f96-7b54d476fd22 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:20.977229 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ad620baa-7b6a-4fa2-9f96-7b54d476fd22 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:20.977694 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ad620baa-7b6a-4fa2-9f96-7b54d476fd22 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:20.978400 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ad620baa-7b6a-4fa2-9f96-7b54d476fd22 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:20.978861 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ad620baa-7b6a-4fa2-9f96-7b54d476fd22 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:20.979308 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ad620baa-7b6a-4fa2-9f96-7b54d476fd22 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:21.054367 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-ad620baa-7b6a-4fa2-9f96-7b54d476fd22 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:21.057802 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell1:SELECT=100 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:53:21.071296 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-ad620baa-7b6a-4fa2-9f96-7b54d476fd22 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa" status: 200 len: 1303 microversion: 2.1 time: 0.106533 Sep 16 09:53:21.071887 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 183/361] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:20 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa => generated 1303 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:21.226394 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-8d35cfe0-efc7-4d6e-aafd-7d0f638871c5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:21.227901 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-8d35cfe0-efc7-4d6e-aafd-7d0f638871c5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:21.234368 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8d35cfe0-efc7-4d6e-aafd-7d0f638871c5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:21.234858 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8d35cfe0-efc7-4d6e-aafd-7d0f638871c5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:21.235925 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8d35cfe0-efc7-4d6e-aafd-7d0f638871c5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:21.237089 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8d35cfe0-efc7-4d6e-aafd-7d0f638871c5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:21.237711 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8d35cfe0-efc7-4d6e-aafd-7d0f638871c5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:21.238268 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8d35cfe0-efc7-4d6e-aafd-7d0f638871c5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:21.447284 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-e77f92e0-3702-4e3d-b3e5-f6084fa26372 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:21.447935 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-e77f92e0-3702-4e3d-b3e5-f6084fa26372 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] [instance: 20bade93-24eb-4e9e-8851-b3ece7eb6fed] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:21.456084 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e77f92e0-3702-4e3d-b3e5-f6084fa26372 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:21.456586 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e77f92e0-3702-4e3d-b3e5-f6084fa26372 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:21.457202 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e77f92e0-3702-4e3d-b3e5-f6084fa26372 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:21.457954 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e77f92e0-3702-4e3d-b3e5-f6084fa26372 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:21.458569 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e77f92e0-3702-4e3d-b3e5-f6084fa26372 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:21.459155 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e77f92e0-3702-4e3d-b3e5-f6084fa26372 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:21.476830 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-8d35cfe0-efc7-4d6e-aafd-7d0f638871c5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:21.485289 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-8d35cfe0-efc7-4d6e-aafd-7d0f638871c5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:21.487326 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-8d35cfe0-efc7-4d6e-aafd-7d0f638871c5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:21.488519 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-8d35cfe0-efc7-4d6e-aafd-7d0f638871c5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1717 microversion: 2.20 time: 0.266154 Sep 16 09:53:21.489074 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 179/362] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:53:21 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1717 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 09:53:21.499055 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-e13fd4b6-22d1-4e3a-aa60-859fcb9ca4d9 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:21.499909 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-e13fd4b6-22d1-4e3a-aa60-859fcb9ca4d9 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: cbfe8395-a1da-4ff2-8951-0ffeaf568bae] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:21.507686 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e13fd4b6-22d1-4e3a-aa60-859fcb9ca4d9 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:21.508192 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e13fd4b6-22d1-4e3a-aa60-859fcb9ca4d9 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:21.508634 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e13fd4b6-22d1-4e3a-aa60-859fcb9ca4d9 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:21.509355 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e13fd4b6-22d1-4e3a-aa60-859fcb9ca4d9 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:21.509849 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e13fd4b6-22d1-4e3a-aa60-859fcb9ca4d9 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:21.510284 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e13fd4b6-22d1-4e3a-aa60-859fcb9ca4d9 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:21.526058 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.wsgi [None req-e13fd4b6-22d1-4e3a-aa60-859fcb9ca4d9 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] HTTP exception thrown: Instance cbfe8395-a1da-4ff2-8951-0ffeaf568bae could not be found. Sep 16 09:53:21.528372 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-e13fd4b6-22d1-4e3a-aa60-859fcb9ca4d9 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Request method failure captured: Sep 16 09:53:21.528372 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: request: GET /compute/v2.1/servers/cbfe8395-a1da-4ff2-8951-0ffeaf568bae HTTP/1.1 Sep 16 09:53:21.528372 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept: application/json Sep 16 09:53:21.528372 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Sep 16 09:53:21.528372 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Connection: close Sep 16 09:53:21.528372 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Length: 0 Sep 16 09:53:21.528372 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Type: application/json Sep 16 09:53:21.528372 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Host: 10.222.0.73 Sep 16 09:53:21.528372 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Sep 16 09:53:21.528372 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Sep 16 09:53:21.528372 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjJEdphSZwvzoT2-lqCThGchFxdcb0TqvZJ5ZydxAP3-pz3hqE3toZz2qpH9SiQILDLAl0t1Jdl8KqR8G1aQwqcZJhCIEwaZ_l8J0WdAtxrJzJ6EfH81zFHazBukwO3B2t6DEDF-CCKNN5qe9iRDRw9GsAkN6DrKQ_gOaNepdw-KaNZJ8 Sep 16 09:53:21.528372 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Sep 16 09:53:21.528372 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Sep 16 09:53:21.528372 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Sep 16 09:53:21.528372 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Sep 16 09:53:21.528372 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Sep 16 09:53:21.528372 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Sep 16 09:53:21.528372 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Id: 6e0c83ab03cd40d6a1ffcc3d5b369d64 Sep 16 09:53:21.528372 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-VolumesActionsTest-1001428782 Sep 16 09:53:21.528372 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Role: reader,member Sep 16 09:53:21.528372 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Roles: reader,member Sep 16 09:53:21.534931 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6e0c83ab03cd40d6a1ffcc3d5b369d64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6e0c83ab03cd40d6a1ffcc3d5b369d64", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6e0c83ab03cd40d6a1ffcc3d5b369d64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6e0c83ab03cd40d6a1ffcc3d5b369d64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 09:53:21.534931 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-VolumesActionsTest-1001428782 Sep 16 09:53:21.534931 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Id: 6e0c83ab03cd40d6a1ffcc3d5b369d64 Sep 16 09:53:21.534931 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-VolumesActionsTest-1001428782 Sep 16 09:53:21.534931 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User: tempest-VolumesActionsTest-1001428782-project Sep 16 09:53:21.534931 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Sep 16 09:53:21.534931 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Sep 16 09:53:21.534931 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Id: 08285b64824b40d384df767c993db55b Sep 16 09:53:21.534931 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-VolumesActionsTest-1001428782-project Sep 16 09:53:21.534931 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: method: > Sep 16 09:53:21.534931 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: exception: Instance cbfe8395-a1da-4ff2-8951-0ffeaf568bae could not be found. Sep 16 09:53:21.534931 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: action_args: {'id': 'cbfe8395-a1da-4ff2-8951-0ffeaf568bae'} Sep 16 09:53:21.535782 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 09:53:21.535782 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:53:21.535782 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 09:53:21.535782 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 09:53:21.535782 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 09:53:21.535782 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 09:53:21.535782 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 09:53:21.535782 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 09:53:21.535782 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 09:53:21.535782 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 09:53:21.535782 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbfe8395-a1da-4ff2-8951-0ffeaf568bae could not be found. Sep 16 09:53:21.535782 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:53:21.535782 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:53:21.535782 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:53:21.535782 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:53:21.535782 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:53:21.535782 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:53:21.535782 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 09:53:21.535782 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 09:53:21.535782 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 09:53:21.537254 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:53:21.537254 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 09:53:21.537254 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 09:53:21.537254 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 09:53:21.537254 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 09:53:21.537254 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 09:53:21.537254 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 09:53:21.537254 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbfe8395-a1da-4ff2-8951-0ffeaf568bae could not be found. Sep 16 09:53:21.537254 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:53:21.537254 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:53:21.537254 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:53:21.537254 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:53:21.537254 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:53:21.537254 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:53:21.537254 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 09:53:21.537254 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 09:53:21.537254 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbfe8395-a1da-4ff2-8951-0ffeaf568bae could not be found. Sep 16 09:53:21.537254 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:53:21.538612 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-e13fd4b6-22d1-4e3a-aa60-859fcb9ca4d9 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Returning 404 to user: Instance cbfe8395-a1da-4ff2-8951-0ffeaf568bae could not be found. {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 09:53:21.538612 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-e13fd4b6-22d1-4e3a-aa60-859fcb9ca4d9 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/cbfe8395-a1da-4ff2-8951-0ffeaf568bae" status: 404 len: 111 microversion: 2.1 time: 0.037236 Sep 16 09:53:21.538612 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 180/363] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:21 2022] GET /compute/v2.1/servers/cbfe8395-a1da-4ff2-8951-0ffeaf568bae => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 09:53:21.551204 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-e77f92e0-3702-4e3d-b3e5-f6084fa26372 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5c42006d0b442cb41952e5af6354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab67e77307d4b8f926244bc18308358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:21.567895 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-e77f92e0-3702-4e3d-b3e5-f6084fa26372 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] 10.222.0.73 "GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed" status: 200 len: 1267 microversion: 2.1 time: 0.124671 Sep 16 09:53:21.590188 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 184/364] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:21 2022] GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed => generated 1267 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:21.675733 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-8259f7e6-5bdd-48d6-ab7d-b903de623f80 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1438418361", "imageRef": "30d28050-ec9d-4227-9bb0-5247430f6177", "flavorRef": "452", "networks": [{"uuid": "15e63dfc-22b7-48c1-94c3-7e5f623a1d1a"}]}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:53:21.741036 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.network.neutron [None req-8259f7e6-5bdd-48d6-ab7d-b903de623f80 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] validate_networks() for [('15e63dfc-22b7-48c1-94c3-7e5f623a1d1a', None, None, None, None, None)] {{(pid=127670) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 09:53:22.096393 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-782b0ecb-760e-4a80-ba1b-5e5de03221a4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:22.101808 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-782b0ecb-760e-4a80-ba1b-5e5de03221a4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:22.112557 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-782b0ecb-760e-4a80-ba1b-5e5de03221a4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:22.113251 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-782b0ecb-760e-4a80-ba1b-5e5de03221a4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:22.113997 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-782b0ecb-760e-4a80-ba1b-5e5de03221a4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:22.115074 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-782b0ecb-760e-4a80-ba1b-5e5de03221a4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:22.115748 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-782b0ecb-760e-4a80-ba1b-5e5de03221a4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:22.116387 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-782b0ecb-760e-4a80-ba1b-5e5de03221a4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:22.358135 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-782b0ecb-760e-4a80-ba1b-5e5de03221a4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:22.369035 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-782b0ecb-760e-4a80-ba1b-5e5de03221a4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa" status: 200 len: 1371 microversion: 2.1 time: 0.277077 Sep 16 09:53:22.369857 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 185/365] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:22 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa => generated 1371 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:22.517068 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-78fcaccd-9e6a-49a2-819d-909efd76e03a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:22.518012 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-78fcaccd-9e6a-49a2-819d-909efd76e03a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:22.525299 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-78fcaccd-9e6a-49a2-819d-909efd76e03a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:22.526247 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-78fcaccd-9e6a-49a2-819d-909efd76e03a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:22.526853 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-78fcaccd-9e6a-49a2-819d-909efd76e03a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:22.527705 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-78fcaccd-9e6a-49a2-819d-909efd76e03a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:22.528313 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-78fcaccd-9e6a-49a2-819d-909efd76e03a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:22.528876 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-78fcaccd-9e6a-49a2-819d-909efd76e03a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:22.555903 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-8259f7e6-5bdd-48d6-ab7d-b903de623f80 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Flavor limits 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 09:53:22.556565 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-8259f7e6-5bdd-48d6-ab7d-b903de623f80 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Image limits 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 09:53:22.557165 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-8259f7e6-5bdd-48d6-ab7d-b903de623f80 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Flavor pref 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 09:53:22.557840 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-8259f7e6-5bdd-48d6-ab7d-b903de623f80 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Image pref 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 09:53:22.558335 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-8259f7e6-5bdd-48d6-ab7d-b903de623f80 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 09:53:22.568839 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8259f7e6-5bdd-48d6-ab7d-b903de623f80 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:22.569463 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8259f7e6-5bdd-48d6-ab7d-b903de623f80 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:22.570008 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8259f7e6-5bdd-48d6-ab7d-b903de623f80 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:22.570814 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8259f7e6-5bdd-48d6-ab7d-b903de623f80 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:22.571371 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8259f7e6-5bdd-48d6-ab7d-b903de623f80 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:22.571874 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8259f7e6-5bdd-48d6-ab7d-b903de623f80 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:22.590701 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-8259f7e6-5bdd-48d6-ab7d-b903de623f80 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Getting quotas for project 6e0c83ab03cd40d6a1ffcc3d5b369d64. Resources: {'instances', 'cores', 'ram'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 09:53:22.595617 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-8259f7e6-5bdd-48d6-ab7d-b903de623f80 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Getting quotas for user 08285b64824b40d384df767c993db55b and project 6e0c83ab03cd40d6a1ffcc3d5b369d64. Resources: {'instances', 'cores', 'ram'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 09:53:22.605593 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:53:22.608502 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-8259f7e6-5bdd-48d6-ab7d-b903de623f80 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Going to run 1 instances... {{(pid=127670) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 09:53:22.612183 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-8259f7e6-5bdd-48d6-ab7d-b903de623f80 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: 60d9ad12-95e0-48c7-8db2-241f7c59cec6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='30d28050-ec9d-4227-9bb0-5247430f6177',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 09:53:22.754162 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-8259f7e6-5bdd-48d6-ab7d-b903de623f80 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.082278 Sep 16 09:53:22.755117 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 181/366] 10.222.0.73 () {60 vars in 1147 bytes} [Fri Sep 16 09:53:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1084 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 09:53:22.766509 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-0a3fb472-422f-4b0e-a058-adb94ad7cf30 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:22.768036 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-0a3fb472-422f-4b0e-a058-adb94ad7cf30 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] [instance: 20bade93-24eb-4e9e-8851-b3ece7eb6fed] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:22.786153 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0a3fb472-422f-4b0e-a058-adb94ad7cf30 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:22.786648 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0a3fb472-422f-4b0e-a058-adb94ad7cf30 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:22.787267 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0a3fb472-422f-4b0e-a058-adb94ad7cf30 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:22.788367 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0a3fb472-422f-4b0e-a058-adb94ad7cf30 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:22.789061 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0a3fb472-422f-4b0e-a058-adb94ad7cf30 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:22.789692 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0a3fb472-422f-4b0e-a058-adb94ad7cf30 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:22.880495 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-0a3fb472-422f-4b0e-a058-adb94ad7cf30 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5c42006d0b442cb41952e5af6354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab67e77307d4b8f926244bc18308358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:22.892182 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-0a3fb472-422f-4b0e-a058-adb94ad7cf30 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] 10.222.0.73 "GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed" status: 200 len: 1273 microversion: 2.1 time: 0.134707 Sep 16 09:53:22.894589 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 182/367] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:22 2022] GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed => generated 1273 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:22.905316 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-93a8e127-3184-42c0-afbf-d8d0cb49bac3 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:22.906434 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-93a8e127-3184-42c0-afbf-d8d0cb49bac3 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: 60d9ad12-95e0-48c7-8db2-241f7c59cec6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:22.961474 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-78fcaccd-9e6a-49a2-819d-909efd76e03a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:22.971250 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-78fcaccd-9e6a-49a2-819d-909efd76e03a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:22.972745 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-78fcaccd-9e6a-49a2-819d-909efd76e03a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:22.977635 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-78fcaccd-9e6a-49a2-819d-909efd76e03a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1717 microversion: 2.20 time: 0.462377 Sep 16 09:53:22.993421 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-93a8e127-3184-42c0-afbf-d8d0cb49bac3 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:22.994074 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 186/368] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:53:22 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1717 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:53:22.994163 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-93a8e127-3184-42c0-afbf-d8d0cb49bac3 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6" status: 200 len: 1214 microversion: 2.1 time: 0.096177 Sep 16 09:53:22.994163 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 183/369] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:22 2022] GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6 => generated 1214 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:23.393881 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-051d4e47-113f-481e-a81c-c1e6f552a9fe tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:23.394499 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-051d4e47-113f-481e-a81c-c1e6f552a9fe tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:23.401298 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-051d4e47-113f-481e-a81c-c1e6f552a9fe tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:23.401816 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-051d4e47-113f-481e-a81c-c1e6f552a9fe tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:23.402255 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-051d4e47-113f-481e-a81c-c1e6f552a9fe tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:23.402955 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-051d4e47-113f-481e-a81c-c1e6f552a9fe tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:23.403675 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-051d4e47-113f-481e-a81c-c1e6f552a9fe tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:23.404284 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-051d4e47-113f-481e-a81c-c1e6f552a9fe tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:23.571160 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-a59277f4-7ccd-4490-9ca5-96b6a2500511 req-94d81ce6-0f36-4d8c-bee3-09a941c1d934 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa", "tag": "6851d923-796f-41a3-a0d3-de42390996fa"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:53:23.583889 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-a59277f4-7ccd-4490-9ca5-96b6a2500511 req-94d81ce6-0f36-4d8c-bee3-09a941c1d934 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:23.584378 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-a59277f4-7ccd-4490-9ca5-96b6a2500511 req-94d81ce6-0f36-4d8c-bee3-09a941c1d934 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:23.585706 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-a59277f4-7ccd-4490-9ca5-96b6a2500511 req-94d81ce6-0f36-4d8c-bee3-09a941c1d934 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:23.596625 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-a59277f4-7ccd-4490-9ca5-96b6a2500511 req-94d81ce6-0f36-4d8c-bee3-09a941c1d934 service nova] Creating event network-changed:6851d923-796f-41a3-a0d3-de42390996fa for instance bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa on hv-cinder-79053 Sep 16 09:53:23.601655 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-a59277f4-7ccd-4490-9ca5-96b6a2500511 req-94d81ce6-0f36-4d8c-bee3-09a941c1d934 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034921 Sep 16 09:53:23.602252 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 184/370] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:53:23.627717 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-051d4e47-113f-481e-a81c-c1e6f552a9fe tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:23.636214 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-051d4e47-113f-481e-a81c-c1e6f552a9fe tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa" status: 200 len: 1371 microversion: 2.1 time: 0.247463 Sep 16 09:53:23.636780 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 187/371] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:23 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa => generated 1371 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:23.921530 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-316d33c9-1af4-40f9-8ea6-4d5eb40e6683 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:23.922391 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-316d33c9-1af4-40f9-8ea6-4d5eb40e6683 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] [instance: 20bade93-24eb-4e9e-8851-b3ece7eb6fed] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:23.929395 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-316d33c9-1af4-40f9-8ea6-4d5eb40e6683 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:23.929943 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-316d33c9-1af4-40f9-8ea6-4d5eb40e6683 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:23.930507 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-316d33c9-1af4-40f9-8ea6-4d5eb40e6683 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:23.931291 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-316d33c9-1af4-40f9-8ea6-4d5eb40e6683 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:23.931907 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-316d33c9-1af4-40f9-8ea6-4d5eb40e6683 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:23.932361 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-316d33c9-1af4-40f9-8ea6-4d5eb40e6683 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:24.005304 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-154bfd69-aae7-4da1-b522-bce672f5307e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:24.006238 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-154bfd69-aae7-4da1-b522-bce672f5307e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:24.014753 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-316d33c9-1af4-40f9-8ea6-4d5eb40e6683 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5c42006d0b442cb41952e5af6354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab67e77307d4b8f926244bc18308358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:24.016677 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-154bfd69-aae7-4da1-b522-bce672f5307e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:24.017588 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-154bfd69-aae7-4da1-b522-bce672f5307e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:24.028708 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-316d33c9-1af4-40f9-8ea6-4d5eb40e6683 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] 10.222.0.73 "GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed" status: 200 len: 1273 microversion: 2.1 time: 0.108989 Sep 16 09:53:24.028708 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 185/372] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:23 2022] GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed => generated 1273 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:24.032544 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-e110e4c3-124d-49e9-8a25-fd8bc95a4549 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:24.033476 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-e110e4c3-124d-49e9-8a25-fd8bc95a4549 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: 60d9ad12-95e0-48c7-8db2-241f7c59cec6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:24.044646 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e110e4c3-124d-49e9-8a25-fd8bc95a4549 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:24.045427 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e110e4c3-124d-49e9-8a25-fd8bc95a4549 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:24.046105 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e110e4c3-124d-49e9-8a25-fd8bc95a4549 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:24.047223 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e110e4c3-124d-49e9-8a25-fd8bc95a4549 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:24.049736 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-154bfd69-aae7-4da1-b522-bce672f5307e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:24.050228 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e110e4c3-124d-49e9-8a25-fd8bc95a4549 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:24.051051 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e110e4c3-124d-49e9-8a25-fd8bc95a4549 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:24.053832 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-154bfd69-aae7-4da1-b522-bce672f5307e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:24.057382 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-154bfd69-aae7-4da1-b522-bce672f5307e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:24.057382 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-154bfd69-aae7-4da1-b522-bce672f5307e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:24.134485 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-e110e4c3-124d-49e9-8a25-fd8bc95a4549 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:24.143745 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-e110e4c3-124d-49e9-8a25-fd8bc95a4549 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6" status: 200 len: 1218 microversion: 2.1 time: 0.115574 Sep 16 09:53:24.145488 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 186/373] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:24 2022] GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6 => generated 1218 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:24.316973 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-154bfd69-aae7-4da1-b522-bce672f5307e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:24.336563 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-154bfd69-aae7-4da1-b522-bce672f5307e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:24.338809 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-154bfd69-aae7-4da1-b522-bce672f5307e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:24.340313 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-154bfd69-aae7-4da1-b522-bce672f5307e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1717 microversion: 2.20 time: 0.339254 Sep 16 09:53:24.341098 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 188/374] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:53:23 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1717 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:53:24.662005 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-c35af7fd-ece3-4b8a-8dbb-caf6d7137709 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:24.663889 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-c35af7fd-ece3-4b8a-8dbb-caf6d7137709 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:24.675953 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c35af7fd-ece3-4b8a-8dbb-caf6d7137709 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:24.677756 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c35af7fd-ece3-4b8a-8dbb-caf6d7137709 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:24.678414 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c35af7fd-ece3-4b8a-8dbb-caf6d7137709 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:24.679243 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c35af7fd-ece3-4b8a-8dbb-caf6d7137709 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:24.679933 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c35af7fd-ece3-4b8a-8dbb-caf6d7137709 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:24.680432 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c35af7fd-ece3-4b8a-8dbb-caf6d7137709 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:24.874316 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c35af7fd-ece3-4b8a-8dbb-caf6d7137709 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:24.883466 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-c35af7fd-ece3-4b8a-8dbb-caf6d7137709 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa" status: 200 len: 1371 microversion: 2.1 time: 0.228096 Sep 16 09:53:24.899931 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 187/375] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:24 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa => generated 1371 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:25.055804 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-01a014ea-821f-4a23-bfaf-52ddc96da793 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:25.079023 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-01a014ea-821f-4a23-bfaf-52ddc96da793 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] [instance: 20bade93-24eb-4e9e-8851-b3ece7eb6fed] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:25.121343 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-01a014ea-821f-4a23-bfaf-52ddc96da793 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:25.122239 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-01a014ea-821f-4a23-bfaf-52ddc96da793 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:25.122987 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-01a014ea-821f-4a23-bfaf-52ddc96da793 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:25.124234 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-01a014ea-821f-4a23-bfaf-52ddc96da793 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:25.124994 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-01a014ea-821f-4a23-bfaf-52ddc96da793 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:25.152455 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-01a014ea-821f-4a23-bfaf-52ddc96da793 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:25.170727 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-e73de017-2f79-4a23-b438-5126f8ea1fba tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:25.171349 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-e73de017-2f79-4a23-b438-5126f8ea1fba tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: 60d9ad12-95e0-48c7-8db2-241f7c59cec6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:25.180890 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e73de017-2f79-4a23-b438-5126f8ea1fba tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:25.188366 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e73de017-2f79-4a23-b438-5126f8ea1fba tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:25.195717 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e73de017-2f79-4a23-b438-5126f8ea1fba tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:25.196808 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e73de017-2f79-4a23-b438-5126f8ea1fba tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:25.197500 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e73de017-2f79-4a23-b438-5126f8ea1fba tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:25.198760 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e73de017-2f79-4a23-b438-5126f8ea1fba tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:25.315579 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-e73de017-2f79-4a23-b438-5126f8ea1fba tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:25.331315 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-e73de017-2f79-4a23-b438-5126f8ea1fba tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6" status: 200 len: 1210 microversion: 2.1 time: 0.163199 Sep 16 09:53:25.338439 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 188/376] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:25 2022] GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6 => generated 1210 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:25.355920 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-f2aec44d-ca77-475c-b13c-e401df6682ac req-244d7498-dd79-40b7-8ff0-5e4bd146ff57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88a0813e-ace7-48df-b688-533c8dbc81de", "name": "network-vif-unplugged", "status": "completed", "tag": "55883b34-2ac0-4ba3-b4af-c5503b0d8fc9"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:53:25.382085 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-f2aec44d-ca77-475c-b13c-e401df6682ac req-244d7498-dd79-40b7-8ff0-5e4bd146ff57 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:25.382653 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-f2aec44d-ca77-475c-b13c-e401df6682ac req-244d7498-dd79-40b7-8ff0-5e4bd146ff57 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:25.383102 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-f2aec44d-ca77-475c-b13c-e401df6682ac req-244d7498-dd79-40b7-8ff0-5e4bd146ff57 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:25.398769 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.compute.server_external_events [req-f2aec44d-ca77-475c-b13c-e401df6682ac req-244d7498-dd79-40b7-8ff0-5e4bd146ff57 service nova] Unable to find a host for instance 88a0813e-ace7-48df-b688-533c8dbc81de. Dropping event network-vif-unplugged {{(pid=127670) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 16 09:53:25.399669 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-f2aec44d-ca77-475c-b13c-e401df6682ac req-244d7498-dd79-40b7-8ff0-5e4bd146ff57 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.060004 Sep 16 09:53:25.411854 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 189/377] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 72 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 16 09:53:25.421292 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-12f5cba6-6e87-403e-a336-d9c03c7317cc tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:25.426259 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-12f5cba6-6e87-403e-a336-d9c03c7317cc tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:25.441410 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-12f5cba6-6e87-403e-a336-d9c03c7317cc tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:25.441943 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-12f5cba6-6e87-403e-a336-d9c03c7317cc tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:25.442381 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-12f5cba6-6e87-403e-a336-d9c03c7317cc tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:25.443091 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-12f5cba6-6e87-403e-a336-d9c03c7317cc tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:25.443549 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-12f5cba6-6e87-403e-a336-d9c03c7317cc tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:25.443979 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-12f5cba6-6e87-403e-a336-d9c03c7317cc tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:25.448458 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-01a014ea-821f-4a23-bfaf-52ddc96da793 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5c42006d0b442cb41952e5af6354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab67e77307d4b8f926244bc18308358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:25.460648 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-01a014ea-821f-4a23-bfaf-52ddc96da793 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] 10.222.0.73 "GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed" status: 200 len: 1315 microversion: 2.1 time: 0.414719 Sep 16 09:53:25.461252 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 189/378] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:25 2022] GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed => generated 1315 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:25.738589 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-12f5cba6-6e87-403e-a336-d9c03c7317cc tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:25.748438 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-12f5cba6-6e87-403e-a336-d9c03c7317cc tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:25.750275 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-12f5cba6-6e87-403e-a336-d9c03c7317cc tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:25.753413 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-12f5cba6-6e87-403e-a336-d9c03c7317cc tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1660 microversion: 2.20 time: 0.339350 Sep 16 09:53:25.753805 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 190/379] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:53:25 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1660 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:53:25.778561 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-26efa459-0b85-40cf-9fec-91a75e7647e8 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e24275f2-d690-4eaf-b3a5-e98b1eccfd54"}} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:53:25.781315 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-26efa459-0b85-40cf-9fec-91a75e7647e8 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:25.788768 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-26efa459-0b85-40cf-9fec-91a75e7647e8 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:25.789757 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-26efa459-0b85-40cf-9fec-91a75e7647e8 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:25.790422 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-26efa459-0b85-40cf-9fec-91a75e7647e8 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:25.791466 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-26efa459-0b85-40cf-9fec-91a75e7647e8 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:25.791932 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-26efa459-0b85-40cf-9fec-91a75e7647e8 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:25.792361 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-26efa459-0b85-40cf-9fec-91a75e7647e8 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:25.907715 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-0d1dd224-2dd3-4aee-a08e-1feb657696c4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:25.908268 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-0d1dd224-2dd3-4aee-a08e-1feb657696c4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:25.914369 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0d1dd224-2dd3-4aee-a08e-1feb657696c4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:25.914858 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0d1dd224-2dd3-4aee-a08e-1feb657696c4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:25.915374 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0d1dd224-2dd3-4aee-a08e-1feb657696c4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:25.915986 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0d1dd224-2dd3-4aee-a08e-1feb657696c4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:25.916449 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0d1dd224-2dd3-4aee-a08e-1feb657696c4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:25.916874 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0d1dd224-2dd3-4aee-a08e-1feb657696c4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:26.139439 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-0d1dd224-2dd3-4aee-a08e-1feb657696c4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:26.148020 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-0d1dd224-2dd3-4aee-a08e-1feb657696c4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa" status: 200 len: 1371 microversion: 2.1 time: 0.244784 Sep 16 09:53:26.148581 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 191/380] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:25 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa => generated 1371 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:53:26.193835 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell0:SELECT=4 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:53:26.355690 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-c3a624e2-429b-44d7-8d51-88f21a63dc77 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:26.356302 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-c3a624e2-429b-44d7-8d51-88f21a63dc77 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: 60d9ad12-95e0-48c7-8db2-241f7c59cec6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:26.363480 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c3a624e2-429b-44d7-8d51-88f21a63dc77 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:26.364046 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c3a624e2-429b-44d7-8d51-88f21a63dc77 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:26.364562 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c3a624e2-429b-44d7-8d51-88f21a63dc77 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:26.365341 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c3a624e2-429b-44d7-8d51-88f21a63dc77 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:26.365892 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c3a624e2-429b-44d7-8d51-88f21a63dc77 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:26.366379 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c3a624e2-429b-44d7-8d51-88f21a63dc77 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:26.430379 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c3a624e2-429b-44d7-8d51-88f21a63dc77 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:26.438369 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-c3a624e2-429b-44d7-8d51-88f21a63dc77 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6" status: 200 len: 1266 microversion: 2.1 time: 0.086323 Sep 16 09:53:26.438941 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 192/381] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:26 2022] GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6 => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:53:26.488153 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-ca1c5143-4088-49c4-a530-df0013e85a59 req-5b066512-125d-4c26-9b24-69c4d079a5d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20bade93-24eb-4e9e-8851-b3ece7eb6fed", "tag": "4302a618-12ca-4b92-bc76-2b29994a3581"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:53:26.501648 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-ca1c5143-4088-49c4-a530-df0013e85a59 req-5b066512-125d-4c26-9b24-69c4d079a5d3 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:26.501648 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-ca1c5143-4088-49c4-a530-df0013e85a59 req-5b066512-125d-4c26-9b24-69c4d079a5d3 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:26.501648 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-ca1c5143-4088-49c4-a530-df0013e85a59 req-5b066512-125d-4c26-9b24-69c4d079a5d3 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:26.511937 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-ca1c5143-4088-49c4-a530-df0013e85a59 req-5b066512-125d-4c26-9b24-69c4d079a5d3 service nova] Creating event network-changed:4302a618-12ca-4b92-bc76-2b29994a3581 for instance 20bade93-24eb-4e9e-8851-b3ece7eb6fed on hv-cinder-79053 Sep 16 09:53:26.517480 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-ca1c5143-4088-49c4-a530-df0013e85a59 req-5b066512-125d-4c26-9b24-69c4d079a5d3 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033198 Sep 16 09:53:26.518691 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 193/382] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 09:53:26.523987 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-3e018fd7-ce0f-4c2b-a23e-0e95119862d8 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:26.524804 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-3e018fd7-ce0f-4c2b-a23e-0e95119862d8 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] [instance: 20bade93-24eb-4e9e-8851-b3ece7eb6fed] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:26.531017 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3e018fd7-ce0f-4c2b-a23e-0e95119862d8 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:26.531513 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3e018fd7-ce0f-4c2b-a23e-0e95119862d8 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:26.532563 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3e018fd7-ce0f-4c2b-a23e-0e95119862d8 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:26.533652 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3e018fd7-ce0f-4c2b-a23e-0e95119862d8 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:26.534127 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3e018fd7-ce0f-4c2b-a23e-0e95119862d8 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:26.534595 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3e018fd7-ce0f-4c2b-a23e-0e95119862d8 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:26.538836 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=100 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:53:26.709110 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-3e018fd7-ce0f-4c2b-a23e-0e95119862d8 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5c42006d0b442cb41952e5af6354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab67e77307d4b8f926244bc18308358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:26.717148 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-3e018fd7-ce0f-4c2b-a23e-0e95119862d8 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] 10.222.0.73 "GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed" status: 200 len: 1315 microversion: 2.1 time: 0.197287 Sep 16 09:53:26.717753 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 194/383] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:26 2022] GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:26.948136 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-26efa459-0b85-40cf-9fec-91a75e7647e8 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "POST /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.173464 Sep 16 09:53:26.948758 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 190/384] 10.222.0.73 () {62 vars in 1364 bytes} [Fri Sep 16 09:53:25 2022] POST /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de/os-volume_attachments => generated 188 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 09:53:27.082853 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d4e5217e-c1e2-4fd7-b9a2-5b90f0bb15bb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:53:27.083447 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-d4e5217e-c1e2-4fd7-b9a2-5b90f0bb15bb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:27.089615 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d4e5217e-c1e2-4fd7-b9a2-5b90f0bb15bb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:27.090112 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d4e5217e-c1e2-4fd7-b9a2-5b90f0bb15bb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:27.091989 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d4e5217e-c1e2-4fd7-b9a2-5b90f0bb15bb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:27.092849 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d4e5217e-c1e2-4fd7-b9a2-5b90f0bb15bb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:27.093329 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d4e5217e-c1e2-4fd7-b9a2-5b90f0bb15bb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:27.093825 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d4e5217e-c1e2-4fd7-b9a2-5b90f0bb15bb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:27.145664 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-d4e5217e-c1e2-4fd7-b9a2-5b90f0bb15bb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127670) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 16 09:53:27.171671 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-75b6908d-4031-4afc-b9a0-891f69c7c0c9 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:27.172283 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-75b6908d-4031-4afc-b9a0-891f69c7c0c9 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:27.180010 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-75b6908d-4031-4afc-b9a0-891f69c7c0c9 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:27.180498 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-75b6908d-4031-4afc-b9a0-891f69c7c0c9 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:27.180932 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-75b6908d-4031-4afc-b9a0-891f69c7c0c9 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:27.181648 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-75b6908d-4031-4afc-b9a0-891f69c7c0c9 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:27.182108 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-75b6908d-4031-4afc-b9a0-891f69c7c0c9 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:27.182529 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-75b6908d-4031-4afc-b9a0-891f69c7c0c9 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:27.333114 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-75b6908d-4031-4afc-b9a0-891f69c7c0c9 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:27.340786 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-75b6908d-4031-4afc-b9a0-891f69c7c0c9 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa" status: 200 len: 1371 microversion: 2.1 time: 0.172997 Sep 16 09:53:27.341584 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 191/385] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:27 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa => generated 1371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:53:27.447660 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-d4e5217e-c1e2-4fd7-b9a2-5b90f0bb15bb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "POST /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de/action" status: 202 len: 0 microversion: 2.20 time: 0.369088 Sep 16 09:53:27.448274 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 195/386] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Sep 16 09:53:27 2022] POST /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de/action => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 16 09:53:27.473736 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-e3efd1af-0715-4275-a785-fbdb82a57189 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:27.474351 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-e3efd1af-0715-4275-a785-fbdb82a57189 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:27.480757 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e3efd1af-0715-4275-a785-fbdb82a57189 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:27.481460 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e3efd1af-0715-4275-a785-fbdb82a57189 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:27.481981 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e3efd1af-0715-4275-a785-fbdb82a57189 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:27.482841 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e3efd1af-0715-4275-a785-fbdb82a57189 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:27.483304 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e3efd1af-0715-4275-a785-fbdb82a57189 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:27.483756 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e3efd1af-0715-4275-a785-fbdb82a57189 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:27.491048 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-9c69dc5d-de38-4c60-996d-a72214a462ff tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:27.491659 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-9c69dc5d-de38-4c60-996d-a72214a462ff tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: 60d9ad12-95e0-48c7-8db2-241f7c59cec6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:27.498242 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9c69dc5d-de38-4c60-996d-a72214a462ff tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:27.499185 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9c69dc5d-de38-4c60-996d-a72214a462ff tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:27.499922 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9c69dc5d-de38-4c60-996d-a72214a462ff tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:27.502365 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9c69dc5d-de38-4c60-996d-a72214a462ff tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:27.503738 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9c69dc5d-de38-4c60-996d-a72214a462ff tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:27.504218 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9c69dc5d-de38-4c60-996d-a72214a462ff tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:27.574987 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-9c69dc5d-de38-4c60-996d-a72214a462ff tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:27.583545 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-9c69dc5d-de38-4c60-996d-a72214a462ff tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6" status: 200 len: 1266 microversion: 2.1 time: 0.096219 Sep 16 09:53:27.595529 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 196/387] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:27 2022] GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6 => generated 1266 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:27.646307 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-e3efd1af-0715-4275-a785-fbdb82a57189 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:27.655186 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-e3efd1af-0715-4275-a785-fbdb82a57189 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:27.656638 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-e3efd1af-0715-4275-a785-fbdb82a57189 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:27.658554 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-e3efd1af-0715-4275-a785-fbdb82a57189 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1746 microversion: 2.20 time: 0.201906 Sep 16 09:53:27.659113 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 192/388] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:53:27 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1746 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:53:27.742219 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-6b37dfb0-8903-40f9-8a77-1284d3492ff5 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:27.744248 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-6b37dfb0-8903-40f9-8a77-1284d3492ff5 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] [instance: 20bade93-24eb-4e9e-8851-b3ece7eb6fed] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:27.752198 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6b37dfb0-8903-40f9-8a77-1284d3492ff5 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:27.752960 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6b37dfb0-8903-40f9-8a77-1284d3492ff5 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:27.753831 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6b37dfb0-8903-40f9-8a77-1284d3492ff5 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:27.754796 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6b37dfb0-8903-40f9-8a77-1284d3492ff5 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:27.755438 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6b37dfb0-8903-40f9-8a77-1284d3492ff5 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:27.755924 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6b37dfb0-8903-40f9-8a77-1284d3492ff5 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:27.903368 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-6b37dfb0-8903-40f9-8a77-1284d3492ff5 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5c42006d0b442cb41952e5af6354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab67e77307d4b8f926244bc18308358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:27.912281 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-6b37dfb0-8903-40f9-8a77-1284d3492ff5 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] 10.222.0.73 "GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed" status: 200 len: 1315 microversion: 2.1 time: 0.173923 Sep 16 09:53:27.912881 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 197/389] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:27 2022] GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:28.365053 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-1a8ab032-6eba-4ccc-b7ae-bd0c09afaf54 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:28.365857 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-1a8ab032-6eba-4ccc-b7ae-bd0c09afaf54 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:28.368858 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell0:SELECT=18 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:53:28.373173 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1a8ab032-6eba-4ccc-b7ae-bd0c09afaf54 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:28.373695 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1a8ab032-6eba-4ccc-b7ae-bd0c09afaf54 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:28.374135 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1a8ab032-6eba-4ccc-b7ae-bd0c09afaf54 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:28.374836 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1a8ab032-6eba-4ccc-b7ae-bd0c09afaf54 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:28.375301 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1a8ab032-6eba-4ccc-b7ae-bd0c09afaf54 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:28.376255 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1a8ab032-6eba-4ccc-b7ae-bd0c09afaf54 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:28.528195 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-1a8ab032-6eba-4ccc-b7ae-bd0c09afaf54 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:28.536424 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-1a8ab032-6eba-4ccc-b7ae-bd0c09afaf54 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa" status: 200 len: 1371 microversion: 2.1 time: 0.176064 Sep 16 09:53:28.549928 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 193/390] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:28 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa => generated 1371 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:28.608027 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-145c0f02-ec53-4c22-a111-d1893011aec9 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:28.608668 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-145c0f02-ec53-4c22-a111-d1893011aec9 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: 60d9ad12-95e0-48c7-8db2-241f7c59cec6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:28.615422 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-145c0f02-ec53-4c22-a111-d1893011aec9 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:28.615859 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-145c0f02-ec53-4c22-a111-d1893011aec9 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:28.616288 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-145c0f02-ec53-4c22-a111-d1893011aec9 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:28.616963 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-145c0f02-ec53-4c22-a111-d1893011aec9 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:28.617423 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-145c0f02-ec53-4c22-a111-d1893011aec9 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:28.617876 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-145c0f02-ec53-4c22-a111-d1893011aec9 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:28.683275 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-145c0f02-ec53-4c22-a111-d1893011aec9 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:28.688440 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-d672794c-fd0e-478c-b6d4-2c8482ec998c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:28.689060 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-d672794c-fd0e-478c-b6d4-2c8482ec998c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:28.692417 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-145c0f02-ec53-4c22-a111-d1893011aec9 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6" status: 200 len: 1266 microversion: 2.1 time: 0.088378 Sep 16 09:53:28.693007 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 198/391] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:28 2022] GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6 => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:28.695210 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d672794c-fd0e-478c-b6d4-2c8482ec998c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:28.695704 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d672794c-fd0e-478c-b6d4-2c8482ec998c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:28.696147 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d672794c-fd0e-478c-b6d4-2c8482ec998c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:28.696854 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d672794c-fd0e-478c-b6d4-2c8482ec998c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:28.697318 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d672794c-fd0e-478c-b6d4-2c8482ec998c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:28.697775 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d672794c-fd0e-478c-b6d4-2c8482ec998c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:28.848347 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-d672794c-fd0e-478c-b6d4-2c8482ec998c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:28.859152 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-d672794c-fd0e-478c-b6d4-2c8482ec998c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:28.862233 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-d672794c-fd0e-478c-b6d4-2c8482ec998c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:28.863500 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-d672794c-fd0e-478c-b6d4-2c8482ec998c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1746 microversion: 2.20 time: 0.180928 Sep 16 09:53:28.870235 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 194/392] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:53:28 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1746 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 09:53:28.937536 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-cfab2e15-f288-4881-9083-1862d60514fe tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:28.939357 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-cfab2e15-f288-4881-9083-1862d60514fe tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] [instance: 20bade93-24eb-4e9e-8851-b3ece7eb6fed] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:28.946533 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cfab2e15-f288-4881-9083-1862d60514fe tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:28.947034 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cfab2e15-f288-4881-9083-1862d60514fe tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:28.947482 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cfab2e15-f288-4881-9083-1862d60514fe tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:28.948188 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cfab2e15-f288-4881-9083-1862d60514fe tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:28.948654 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cfab2e15-f288-4881-9083-1862d60514fe tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:28.949083 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cfab2e15-f288-4881-9083-1862d60514fe tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:29.126041 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-cfab2e15-f288-4881-9083-1862d60514fe tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5c42006d0b442cb41952e5af6354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab67e77307d4b8f926244bc18308358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:29.137264 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-cfab2e15-f288-4881-9083-1862d60514fe tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] 10.222.0.73 "GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed" status: 200 len: 1315 microversion: 2.1 time: 0.204551 Sep 16 09:53:29.149569 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 199/393] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:28 2022] GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:29.559382 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-d9859207-7794-4589-9ec8-69984b603a60 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:29.560071 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-d9859207-7794-4589-9ec8-69984b603a60 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:29.567603 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d9859207-7794-4589-9ec8-69984b603a60 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:29.568096 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d9859207-7794-4589-9ec8-69984b603a60 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:29.568542 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d9859207-7794-4589-9ec8-69984b603a60 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:29.569242 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d9859207-7794-4589-9ec8-69984b603a60 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:29.569732 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d9859207-7794-4589-9ec8-69984b603a60 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:29.570165 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d9859207-7794-4589-9ec8-69984b603a60 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:29.715734 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-9a41c521-97c8-4e98-bf85-8be532286667 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:29.716348 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-9a41c521-97c8-4e98-bf85-8be532286667 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: 60d9ad12-95e0-48c7-8db2-241f7c59cec6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:29.723275 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9a41c521-97c8-4e98-bf85-8be532286667 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:29.723891 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-d9859207-7794-4589-9ec8-69984b603a60 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:29.724868 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9a41c521-97c8-4e98-bf85-8be532286667 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:29.725741 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9a41c521-97c8-4e98-bf85-8be532286667 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:29.726971 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9a41c521-97c8-4e98-bf85-8be532286667 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:29.727629 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9a41c521-97c8-4e98-bf85-8be532286667 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:29.728234 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9a41c521-97c8-4e98-bf85-8be532286667 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:29.742884 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-d9859207-7794-4589-9ec8-69984b603a60 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa" status: 200 len: 1371 microversion: 2.1 time: 0.187261 Sep 16 09:53:29.745940 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 195/394] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:29 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa => generated 1371 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:29.836608 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-9a41c521-97c8-4e98-bf85-8be532286667 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:29.846057 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-9a41c521-97c8-4e98-bf85-8be532286667 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6" status: 200 len: 1266 microversion: 2.1 time: 0.134061 Sep 16 09:53:29.846632 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 200/395] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:29 2022] GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6 => generated 1266 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:29.889340 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-de0bc194-75c4-4109-98cc-ca9add06c3d2 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:29.890029 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-de0bc194-75c4-4109-98cc-ca9add06c3d2 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:29.897720 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-de0bc194-75c4-4109-98cc-ca9add06c3d2 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:29.898489 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-de0bc194-75c4-4109-98cc-ca9add06c3d2 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:29.898936 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-de0bc194-75c4-4109-98cc-ca9add06c3d2 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:29.899645 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-de0bc194-75c4-4109-98cc-ca9add06c3d2 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:29.900572 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-de0bc194-75c4-4109-98cc-ca9add06c3d2 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:29.901128 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-de0bc194-75c4-4109-98cc-ca9add06c3d2 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:30.040048 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-de0bc194-75c4-4109-98cc-ca9add06c3d2 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:30.050349 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-de0bc194-75c4-4109-98cc-ca9add06c3d2 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:30.052032 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-de0bc194-75c4-4109-98cc-ca9add06c3d2 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:30.053214 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-de0bc194-75c4-4109-98cc-ca9add06c3d2 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1748 microversion: 2.20 time: 0.167911 Sep 16 09:53:30.054011 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 196/396] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:53:29 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1748 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:53:30.162558 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-2ee4b4ec-9a3c-44e2-a9f9-5fe215ad1dd4 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:30.163467 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-2ee4b4ec-9a3c-44e2-a9f9-5fe215ad1dd4 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] [instance: 20bade93-24eb-4e9e-8851-b3ece7eb6fed] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:30.170056 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2ee4b4ec-9a3c-44e2-a9f9-5fe215ad1dd4 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:30.170544 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2ee4b4ec-9a3c-44e2-a9f9-5fe215ad1dd4 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:30.171062 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2ee4b4ec-9a3c-44e2-a9f9-5fe215ad1dd4 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:30.171756 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2ee4b4ec-9a3c-44e2-a9f9-5fe215ad1dd4 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:30.172256 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2ee4b4ec-9a3c-44e2-a9f9-5fe215ad1dd4 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:30.173628 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2ee4b4ec-9a3c-44e2-a9f9-5fe215ad1dd4 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:30.369184 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-2ee4b4ec-9a3c-44e2-a9f9-5fe215ad1dd4 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5c42006d0b442cb41952e5af6354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab67e77307d4b8f926244bc18308358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:30.377450 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-2ee4b4ec-9a3c-44e2-a9f9-5fe215ad1dd4 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] 10.222.0.73 "GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed" status: 200 len: 1315 microversion: 2.1 time: 0.218719 Sep 16 09:53:30.378048 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 201/397] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:30 2022] GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:30.767520 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-b1c0c463-7a0f-4fc7-aeef-26719e42a593 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:30.768792 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-b1c0c463-7a0f-4fc7-aeef-26719e42a593 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:30.772126 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:53:30.777994 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b1c0c463-7a0f-4fc7-aeef-26719e42a593 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:30.778765 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b1c0c463-7a0f-4fc7-aeef-26719e42a593 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:30.779371 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b1c0c463-7a0f-4fc7-aeef-26719e42a593 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:30.780291 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b1c0c463-7a0f-4fc7-aeef-26719e42a593 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:30.780977 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b1c0c463-7a0f-4fc7-aeef-26719e42a593 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:30.781678 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b1c0c463-7a0f-4fc7-aeef-26719e42a593 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:30.869884 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-1ba07e04-50b1-427d-9d89-f5e6c0f17791 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:30.870480 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-1ba07e04-50b1-427d-9d89-f5e6c0f17791 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: 60d9ad12-95e0-48c7-8db2-241f7c59cec6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:30.877144 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1ba07e04-50b1-427d-9d89-f5e6c0f17791 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:30.881884 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1ba07e04-50b1-427d-9d89-f5e6c0f17791 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:30.882371 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1ba07e04-50b1-427d-9d89-f5e6c0f17791 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:30.883109 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1ba07e04-50b1-427d-9d89-f5e6c0f17791 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:30.883578 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1ba07e04-50b1-427d-9d89-f5e6c0f17791 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:30.884009 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1ba07e04-50b1-427d-9d89-f5e6c0f17791 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:30.934277 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-b1c0c463-7a0f-4fc7-aeef-26719e42a593 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:30.937726 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:53:30.943844 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-b1c0c463-7a0f-4fc7-aeef-26719e42a593 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa" status: 200 len: 1371 microversion: 2.1 time: 0.181866 Sep 16 09:53:30.944461 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 197/398] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:30 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa => generated 1371 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:30.954958 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-1ba07e04-50b1-427d-9d89-f5e6c0f17791 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:30.965245 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-1ba07e04-50b1-427d-9d89-f5e6c0f17791 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6" status: 200 len: 1274 microversion: 2.1 time: 0.099142 Sep 16 09:53:30.967055 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 202/399] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:30 2022] GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6 => generated 1274 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:31.078957 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-040979f4-bee6-4c2f-94a3-b91358aa07a4 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:31.079563 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-040979f4-bee6-4c2f-94a3-b91358aa07a4 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:31.085803 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-040979f4-bee6-4c2f-94a3-b91358aa07a4 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:31.086490 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-040979f4-bee6-4c2f-94a3-b91358aa07a4 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:31.086925 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-040979f4-bee6-4c2f-94a3-b91358aa07a4 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:31.087629 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-040979f4-bee6-4c2f-94a3-b91358aa07a4 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:31.088088 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-040979f4-bee6-4c2f-94a3-b91358aa07a4 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:31.088510 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-040979f4-bee6-4c2f-94a3-b91358aa07a4 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:31.240495 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-040979f4-bee6-4c2f-94a3-b91358aa07a4 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:31.252312 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-040979f4-bee6-4c2f-94a3-b91358aa07a4 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:31.254000 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-040979f4-bee6-4c2f-94a3-b91358aa07a4 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:31.255201 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-040979f4-bee6-4c2f-94a3-b91358aa07a4 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1748 microversion: 2.20 time: 0.180264 Sep 16 09:53:31.256642 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 198/400] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:53:31 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1748 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:53:31.400501 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-00458c8c-f8d0-483a-aa9e-cd50ead2605e tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:31.402392 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-00458c8c-f8d0-483a-aa9e-cd50ead2605e tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] [instance: 20bade93-24eb-4e9e-8851-b3ece7eb6fed] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:31.412182 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-00458c8c-f8d0-483a-aa9e-cd50ead2605e tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:31.413750 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-00458c8c-f8d0-483a-aa9e-cd50ead2605e tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:31.414461 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-00458c8c-f8d0-483a-aa9e-cd50ead2605e tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:31.415845 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-00458c8c-f8d0-483a-aa9e-cd50ead2605e tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:31.416787 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-00458c8c-f8d0-483a-aa9e-cd50ead2605e tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:31.417227 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-00458c8c-f8d0-483a-aa9e-cd50ead2605e tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:31.619073 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-00458c8c-f8d0-483a-aa9e-cd50ead2605e tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5c42006d0b442cb41952e5af6354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab67e77307d4b8f926244bc18308358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:31.627867 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-00458c8c-f8d0-483a-aa9e-cd50ead2605e tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] 10.222.0.73 "GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed" status: 200 len: 1315 microversion: 2.1 time: 0.231211 Sep 16 09:53:31.628543 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 203/401] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:31 2022] GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:31.968015 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-5f249c52-9aab-46d5-aa41-196907874cb6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:31.968859 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-5f249c52-9aab-46d5-aa41-196907874cb6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:31.976449 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5f249c52-9aab-46d5-aa41-196907874cb6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:31.976945 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5f249c52-9aab-46d5-aa41-196907874cb6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:31.977612 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5f249c52-9aab-46d5-aa41-196907874cb6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:31.978329 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5f249c52-9aab-46d5-aa41-196907874cb6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:31.978823 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5f249c52-9aab-46d5-aa41-196907874cb6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:31.979257 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5f249c52-9aab-46d5-aa41-196907874cb6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:31.989959 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-da290904-a645-4642-8355-6fb8194ee6d0 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:31.990574 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-da290904-a645-4642-8355-6fb8194ee6d0 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: 60d9ad12-95e0-48c7-8db2-241f7c59cec6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:31.998691 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-da290904-a645-4642-8355-6fb8194ee6d0 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:31.999194 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-da290904-a645-4642-8355-6fb8194ee6d0 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:31.999794 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-da290904-a645-4642-8355-6fb8194ee6d0 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:32.001832 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-da290904-a645-4642-8355-6fb8194ee6d0 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:32.002382 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-da290904-a645-4642-8355-6fb8194ee6d0 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:32.002867 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-da290904-a645-4642-8355-6fb8194ee6d0 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:32.121778 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-5f249c52-9aab-46d5-aa41-196907874cb6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:32.132223 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-5f249c52-9aab-46d5-aa41-196907874cb6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa" status: 200 len: 1371 microversion: 2.1 time: 0.168013 Sep 16 09:53:32.132223 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 199/402] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:31 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:32.145682 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [req-15d1733a-dcd6-46e3-8702-b30521b0dc26 req-b451c7a2-3d91-4bb2-bad6-5435cbe7d048 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60d9ad12-95e0-48c7-8db2-241f7c59cec6", "tag": "e2f73010-dd79-4f94-88e0-b0b0a4af8ed6"}]} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:53:32.155125 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-15d1733a-dcd6-46e3-8702-b30521b0dc26 req-b451c7a2-3d91-4bb2-bad6-5435cbe7d048 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:32.155585 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-15d1733a-dcd6-46e3-8702-b30521b0dc26 req-b451c7a2-3d91-4bb2-bad6-5435cbe7d048 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:32.156016 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-15d1733a-dcd6-46e3-8702-b30521b0dc26 req-b451c7a2-3d91-4bb2-bad6-5435cbe7d048 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:32.167676 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.compute.server_external_events [req-15d1733a-dcd6-46e3-8702-b30521b0dc26 req-b451c7a2-3d91-4bb2-bad6-5435cbe7d048 service nova] Creating event network-changed:e2f73010-dd79-4f94-88e0-b0b0a4af8ed6 for instance 60d9ad12-95e0-48c7-8db2-241f7c59cec6 on hv-cinder-79053 Sep 16 09:53:32.173260 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [req-15d1733a-dcd6-46e3-8702-b30521b0dc26 req-b451c7a2-3d91-4bb2-bad6-5435cbe7d048 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030987 Sep 16 09:53:32.174067 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 200/403] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 09:53:32.212331 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-da290904-a645-4642-8355-6fb8194ee6d0 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:32.221676 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-da290904-a645-4642-8355-6fb8194ee6d0 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6" status: 200 len: 1314 microversion: 2.1 time: 0.236573 Sep 16 09:53:32.222267 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 204/404] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:31 2022] GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:53:32.282609 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-9c39f368-5ef4-46df-ba84-95c34aa8f239 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:32.283421 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-9c39f368-5ef4-46df-ba84-95c34aa8f239 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:32.289630 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9c39f368-5ef4-46df-ba84-95c34aa8f239 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:32.290136 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9c39f368-5ef4-46df-ba84-95c34aa8f239 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:32.290574 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9c39f368-5ef4-46df-ba84-95c34aa8f239 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:32.291266 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9c39f368-5ef4-46df-ba84-95c34aa8f239 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:32.291728 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9c39f368-5ef4-46df-ba84-95c34aa8f239 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:32.292152 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9c39f368-5ef4-46df-ba84-95c34aa8f239 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:32.431043 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-9c39f368-5ef4-46df-ba84-95c34aa8f239 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:32.440332 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-9c39f368-5ef4-46df-ba84-95c34aa8f239 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:32.442879 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-9c39f368-5ef4-46df-ba84-95c34aa8f239 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:32.444105 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-9c39f368-5ef4-46df-ba84-95c34aa8f239 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1748 microversion: 2.20 time: 0.166447 Sep 16 09:53:32.444105 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 201/405] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:53:32 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1748 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:53:32.651979 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d94390c3-68bb-451e-bfe2-1275c072d3e1 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:32.652511 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-d94390c3-68bb-451e-bfe2-1275c072d3e1 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] [instance: 20bade93-24eb-4e9e-8851-b3ece7eb6fed] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:32.654437 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell0:SELECT=2 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:53:32.659841 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d94390c3-68bb-451e-bfe2-1275c072d3e1 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:32.660481 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d94390c3-68bb-451e-bfe2-1275c072d3e1 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:32.660861 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d94390c3-68bb-451e-bfe2-1275c072d3e1 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:32.661614 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d94390c3-68bb-451e-bfe2-1275c072d3e1 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:32.662043 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d94390c3-68bb-451e-bfe2-1275c072d3e1 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:32.665731 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d94390c3-68bb-451e-bfe2-1275c072d3e1 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:32.794683 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-d94390c3-68bb-451e-bfe2-1275c072d3e1 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5c42006d0b442cb41952e5af6354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab67e77307d4b8f926244bc18308358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:32.803110 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-d94390c3-68bb-451e-bfe2-1275c072d3e1 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] 10.222.0.73 "GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed" status: 200 len: 1315 microversion: 2.1 time: 0.155125 Sep 16 09:53:32.803689 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 205/406] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:32 2022] GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:33.155152 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-7db759e5-eef0-4525-a95f-d6dcb7736459 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:33.155788 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-7db759e5-eef0-4525-a95f-d6dcb7736459 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:33.164224 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7db759e5-eef0-4525-a95f-d6dcb7736459 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:33.164723 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7db759e5-eef0-4525-a95f-d6dcb7736459 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:33.165170 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7db759e5-eef0-4525-a95f-d6dcb7736459 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:33.165898 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7db759e5-eef0-4525-a95f-d6dcb7736459 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:33.166370 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7db759e5-eef0-4525-a95f-d6dcb7736459 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:33.166809 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7db759e5-eef0-4525-a95f-d6dcb7736459 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:33.246136 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-142689b2-3866-4484-882c-3a79b4de8618 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:33.246745 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-142689b2-3866-4484-882c-3a79b4de8618 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: 60d9ad12-95e0-48c7-8db2-241f7c59cec6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:33.249092 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell0:SELECT=12 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:53:33.254219 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-142689b2-3866-4484-882c-3a79b4de8618 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:33.254709 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-142689b2-3866-4484-882c-3a79b4de8618 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:33.255278 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-142689b2-3866-4484-882c-3a79b4de8618 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:33.255986 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-142689b2-3866-4484-882c-3a79b4de8618 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:33.256442 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-142689b2-3866-4484-882c-3a79b4de8618 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:33.256866 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-142689b2-3866-4484-882c-3a79b4de8618 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:33.304037 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-7db759e5-eef0-4525-a95f-d6dcb7736459 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:33.311672 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-7db759e5-eef0-4525-a95f-d6dcb7736459 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa" status: 200 len: 1371 microversion: 2.1 time: 0.160415 Sep 16 09:53:33.312239 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 202/407] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:33 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:33.386787 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-142689b2-3866-4484-882c-3a79b4de8618 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:33.395276 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-142689b2-3866-4484-882c-3a79b4de8618 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6" status: 200 len: 1314 microversion: 2.1 time: 0.153374 Sep 16 09:53:33.395840 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 206/408] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:33 2022] GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:53:33.469515 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-4c9b8ab2-e8e5-4812-8c81-056c5c0783ee tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:33.470178 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-4c9b8ab2-e8e5-4812-8c81-056c5c0783ee tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:33.476928 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4c9b8ab2-e8e5-4812-8c81-056c5c0783ee tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:33.477405 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4c9b8ab2-e8e5-4812-8c81-056c5c0783ee tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:33.477885 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4c9b8ab2-e8e5-4812-8c81-056c5c0783ee tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:33.478576 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4c9b8ab2-e8e5-4812-8c81-056c5c0783ee tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:33.479025 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4c9b8ab2-e8e5-4812-8c81-056c5c0783ee tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:33.479446 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4c9b8ab2-e8e5-4812-8c81-056c5c0783ee tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:33.608622 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-4c9b8ab2-e8e5-4812-8c81-056c5c0783ee tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:33.618560 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-4c9b8ab2-e8e5-4812-8c81-056c5c0783ee tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:33.620018 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-4c9b8ab2-e8e5-4812-8c81-056c5c0783ee tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:33.621181 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-4c9b8ab2-e8e5-4812-8c81-056c5c0783ee tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1748 microversion: 2.20 time: 0.155622 Sep 16 09:53:33.621773 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 203/409] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:53:33 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1748 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:53:33.826644 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-4ec36b36-a388-42a5-943b-f50b84492fab tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:33.831780 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-4ec36b36-a388-42a5-943b-f50b84492fab tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] [instance: 20bade93-24eb-4e9e-8851-b3ece7eb6fed] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:33.833673 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4ec36b36-a388-42a5-943b-f50b84492fab tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:33.834167 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4ec36b36-a388-42a5-943b-f50b84492fab tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:33.834605 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4ec36b36-a388-42a5-943b-f50b84492fab tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:33.835300 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4ec36b36-a388-42a5-943b-f50b84492fab tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:33.835766 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4ec36b36-a388-42a5-943b-f50b84492fab tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:33.836196 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4ec36b36-a388-42a5-943b-f50b84492fab tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:33.971740 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-4ec36b36-a388-42a5-943b-f50b84492fab tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5c42006d0b442cb41952e5af6354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab67e77307d4b8f926244bc18308358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:33.979379 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-4ec36b36-a388-42a5-943b-f50b84492fab tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] 10.222.0.73 "GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed" status: 200 len: 1315 microversion: 2.1 time: 0.156801 Sep 16 09:53:33.980009 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 207/410] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:33 2022] GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:34.336750 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-f3dd0321-6f6a-45c2-8605-e966fe6b3bd2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:34.337293 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-f3dd0321-6f6a-45c2-8605-e966fe6b3bd2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:34.345098 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f3dd0321-6f6a-45c2-8605-e966fe6b3bd2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:34.346178 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f3dd0321-6f6a-45c2-8605-e966fe6b3bd2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:34.346943 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f3dd0321-6f6a-45c2-8605-e966fe6b3bd2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:34.347876 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f3dd0321-6f6a-45c2-8605-e966fe6b3bd2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:34.348344 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f3dd0321-6f6a-45c2-8605-e966fe6b3bd2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:34.348777 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f3dd0321-6f6a-45c2-8605-e966fe6b3bd2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:34.418290 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-480e8ec0-900b-4c41-98e9-75fdc18939dc tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:34.419017 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-480e8ec0-900b-4c41-98e9-75fdc18939dc tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: 60d9ad12-95e0-48c7-8db2-241f7c59cec6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:34.426087 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-480e8ec0-900b-4c41-98e9-75fdc18939dc tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:34.426652 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-480e8ec0-900b-4c41-98e9-75fdc18939dc tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:34.427265 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-480e8ec0-900b-4c41-98e9-75fdc18939dc tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:34.427984 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-480e8ec0-900b-4c41-98e9-75fdc18939dc tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:34.428583 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-480e8ec0-900b-4c41-98e9-75fdc18939dc tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:34.429074 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-480e8ec0-900b-4c41-98e9-75fdc18939dc tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:34.578291 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-f3dd0321-6f6a-45c2-8605-e966fe6b3bd2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:34.588606 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-f3dd0321-6f6a-45c2-8605-e966fe6b3bd2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa" status: 200 len: 1371 microversion: 2.1 time: 0.256608 Sep 16 09:53:34.597840 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 204/411] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:34 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa => generated 1371 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:34.659571 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-b41e05d5-d0fd-4491-b0ad-9c6b2f112475 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:34.660221 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-b41e05d5-d0fd-4491-b0ad-9c6b2f112475 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:34.666590 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b41e05d5-d0fd-4491-b0ad-9c6b2f112475 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:34.667082 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b41e05d5-d0fd-4491-b0ad-9c6b2f112475 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:34.667522 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b41e05d5-d0fd-4491-b0ad-9c6b2f112475 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:34.670686 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b41e05d5-d0fd-4491-b0ad-9c6b2f112475 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:34.671162 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b41e05d5-d0fd-4491-b0ad-9c6b2f112475 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:34.671759 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b41e05d5-d0fd-4491-b0ad-9c6b2f112475 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:34.685534 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-480e8ec0-900b-4c41-98e9-75fdc18939dc tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:34.696835 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-480e8ec0-900b-4c41-98e9-75fdc18939dc tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6" status: 200 len: 1314 microversion: 2.1 time: 0.281727 Sep 16 09:53:34.698602 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 208/412] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:34 2022] GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6 => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:53:34.926748 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-b41e05d5-d0fd-4491-b0ad-9c6b2f112475 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:34.937376 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-b41e05d5-d0fd-4491-b0ad-9c6b2f112475 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:34.940455 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-b41e05d5-d0fd-4491-b0ad-9c6b2f112475 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:34.942669 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-b41e05d5-d0fd-4491-b0ad-9c6b2f112475 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1804 microversion: 2.20 time: 0.297285 Sep 16 09:53:34.943516 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 205/413] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:53:34 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1804 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 09:53:35.004268 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-83490177-5ae5-4b64-9090-9eacb49ea054 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:35.004891 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-83490177-5ae5-4b64-9090-9eacb49ea054 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] [instance: 20bade93-24eb-4e9e-8851-b3ece7eb6fed] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:35.015261 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-83490177-5ae5-4b64-9090-9eacb49ea054 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:35.017241 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-83490177-5ae5-4b64-9090-9eacb49ea054 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:35.018881 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-83490177-5ae5-4b64-9090-9eacb49ea054 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:35.021721 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-83490177-5ae5-4b64-9090-9eacb49ea054 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:35.030074 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-83490177-5ae5-4b64-9090-9eacb49ea054 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:35.030074 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-83490177-5ae5-4b64-9090-9eacb49ea054 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:35.041687 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [req-d92e4794-c532-480c-a65c-52adc1ff292e req-9b9b3828-4841-4d12-b17c-895da5b1f946 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa", "name": "network-vif-plugged", "status": "completed", "tag": "6851d923-796f-41a3-a0d3-de42390996fa"}]} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:53:35.057572 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-d92e4794-c532-480c-a65c-52adc1ff292e req-9b9b3828-4841-4d12-b17c-895da5b1f946 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:35.060550 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-d92e4794-c532-480c-a65c-52adc1ff292e req-9b9b3828-4841-4d12-b17c-895da5b1f946 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:35.061048 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-d92e4794-c532-480c-a65c-52adc1ff292e req-9b9b3828-4841-4d12-b17c-895da5b1f946 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:35.079378 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.compute.server_external_events [req-d92e4794-c532-480c-a65c-52adc1ff292e req-9b9b3828-4841-4d12-b17c-895da5b1f946 service nova] Creating event network-vif-plugged:6851d923-796f-41a3-a0d3-de42390996fa for instance bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa on hv-cinder-79053 Sep 16 09:53:35.104477 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [req-d92e4794-c532-480c-a65c-52adc1ff292e req-9b9b3828-4841-4d12-b17c-895da5b1f946 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064672 Sep 16 09:53:35.107634 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 206/414] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 09:53:35.255725 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-83490177-5ae5-4b64-9090-9eacb49ea054 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5c42006d0b442cb41952e5af6354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab67e77307d4b8f926244bc18308358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:35.258870 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:53:35.266425 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-83490177-5ae5-4b64-9090-9eacb49ea054 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] 10.222.0.73 "GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed" status: 200 len: 1315 microversion: 2.1 time: 0.267145 Sep 16 09:53:35.268915 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 209/415] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:34 2022] GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:35.613042 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-66f67f97-acec-4849-9b19-ccce2694795a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:35.613787 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-66f67f97-acec-4849-9b19-ccce2694795a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:35.620890 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-66f67f97-acec-4849-9b19-ccce2694795a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:35.621381 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-66f67f97-acec-4849-9b19-ccce2694795a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:35.621854 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-66f67f97-acec-4849-9b19-ccce2694795a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:35.622559 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-66f67f97-acec-4849-9b19-ccce2694795a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:35.623087 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-66f67f97-acec-4849-9b19-ccce2694795a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:35.623514 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-66f67f97-acec-4849-9b19-ccce2694795a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:35.721858 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-21fe8dcb-aefc-4a30-95f3-0c0cef0acd68 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:35.722534 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-21fe8dcb-aefc-4a30-95f3-0c0cef0acd68 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: 60d9ad12-95e0-48c7-8db2-241f7c59cec6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:35.743824 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-21fe8dcb-aefc-4a30-95f3-0c0cef0acd68 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:35.744423 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-21fe8dcb-aefc-4a30-95f3-0c0cef0acd68 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:35.744945 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-21fe8dcb-aefc-4a30-95f3-0c0cef0acd68 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:35.745834 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-21fe8dcb-aefc-4a30-95f3-0c0cef0acd68 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:35.746304 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-21fe8dcb-aefc-4a30-95f3-0c0cef0acd68 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:35.746785 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-21fe8dcb-aefc-4a30-95f3-0c0cef0acd68 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:35.795383 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-66f67f97-acec-4849-9b19-ccce2694795a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:35.804680 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-66f67f97-acec-4849-9b19-ccce2694795a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa" status: 200 len: 1371 microversion: 2.1 time: 0.197294 Sep 16 09:53:35.805804 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 207/416] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:35 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa => generated 1371 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:35.897932 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-21fe8dcb-aefc-4a30-95f3-0c0cef0acd68 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:35.906221 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-21fe8dcb-aefc-4a30-95f3-0c0cef0acd68 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6" status: 200 len: 1314 microversion: 2.1 time: 0.189737 Sep 16 09:53:35.906787 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 210/417] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:35 2022] GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:53:35.971808 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-e9ad859c-80e0-4ab2-94bf-cb17c21933bc tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:35.972502 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-e9ad859c-80e0-4ab2-94bf-cb17c21933bc tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:35.978887 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e9ad859c-80e0-4ab2-94bf-cb17c21933bc tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:35.979386 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e9ad859c-80e0-4ab2-94bf-cb17c21933bc tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:35.979839 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e9ad859c-80e0-4ab2-94bf-cb17c21933bc tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:35.980588 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e9ad859c-80e0-4ab2-94bf-cb17c21933bc tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:35.981045 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e9ad859c-80e0-4ab2-94bf-cb17c21933bc tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:35.981500 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e9ad859c-80e0-4ab2-94bf-cb17c21933bc tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:36.116374 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-e9ad859c-80e0-4ab2-94bf-cb17c21933bc tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:36.125593 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-e9ad859c-80e0-4ab2-94bf-cb17c21933bc tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:36.127590 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-e9ad859c-80e0-4ab2-94bf-cb17c21933bc tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:36.128778 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-e9ad859c-80e0-4ab2-94bf-cb17c21933bc tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1804 microversion: 2.20 time: 0.162681 Sep 16 09:53:36.129344 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 208/418] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:53:35 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1804 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:53:36.420381 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-a913e930-5792-4ca7-8cfd-0d0395440e16 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:36.421000 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-a913e930-5792-4ca7-8cfd-0d0395440e16 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] [instance: 20bade93-24eb-4e9e-8851-b3ece7eb6fed] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:36.427927 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a913e930-5792-4ca7-8cfd-0d0395440e16 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:36.431684 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a913e930-5792-4ca7-8cfd-0d0395440e16 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:36.431684 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a913e930-5792-4ca7-8cfd-0d0395440e16 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:36.431684 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a913e930-5792-4ca7-8cfd-0d0395440e16 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:36.431684 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a913e930-5792-4ca7-8cfd-0d0395440e16 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:36.432267 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a913e930-5792-4ca7-8cfd-0d0395440e16 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:36.571030 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-a913e930-5792-4ca7-8cfd-0d0395440e16 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5c42006d0b442cb41952e5af6354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab67e77307d4b8f926244bc18308358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:36.579041 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-a913e930-5792-4ca7-8cfd-0d0395440e16 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] 10.222.0.73 "GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed" status: 200 len: 1315 microversion: 2.1 time: 0.162598 Sep 16 09:53:36.580214 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 211/419] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:36 2022] GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:36.828619 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-a746b107-04d6-4f25-a766-a131c394e329 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:36.829291 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-a746b107-04d6-4f25-a766-a131c394e329 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:36.836877 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a746b107-04d6-4f25-a766-a131c394e329 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:36.837365 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a746b107-04d6-4f25-a766-a131c394e329 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:36.837845 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a746b107-04d6-4f25-a766-a131c394e329 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:36.838557 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a746b107-04d6-4f25-a766-a131c394e329 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:36.839023 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a746b107-04d6-4f25-a766-a131c394e329 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:36.839454 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a746b107-04d6-4f25-a766-a131c394e329 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:36.930360 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-ea4fb69b-217d-48cb-a508-d26afb37eff9 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:36.930980 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-ea4fb69b-217d-48cb-a508-d26afb37eff9 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: 60d9ad12-95e0-48c7-8db2-241f7c59cec6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:36.937752 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ea4fb69b-217d-48cb-a508-d26afb37eff9 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:36.938452 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ea4fb69b-217d-48cb-a508-d26afb37eff9 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:36.939462 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ea4fb69b-217d-48cb-a508-d26afb37eff9 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:36.940233 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ea4fb69b-217d-48cb-a508-d26afb37eff9 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:36.940811 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ea4fb69b-217d-48cb-a508-d26afb37eff9 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:36.941247 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ea4fb69b-217d-48cb-a508-d26afb37eff9 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:36.985100 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-a746b107-04d6-4f25-a766-a131c394e329 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:36.994284 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-a746b107-04d6-4f25-a766-a131c394e329 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa" status: 200 len: 1371 microversion: 2.1 time: 0.169636 Sep 16 09:53:36.994861 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 209/420] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:36 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:53:37.073659 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-ea4fb69b-217d-48cb-a508-d26afb37eff9 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:37.081490 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-ea4fb69b-217d-48cb-a508-d26afb37eff9 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6" status: 200 len: 1314 microversion: 2.1 time: 0.154836 Sep 16 09:53:37.082200 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 212/421] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:36 2022] GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:53:37.155165 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-24b80a94-1bc7-4aad-8092-8dcf59678618 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:37.155773 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-24b80a94-1bc7-4aad-8092-8dcf59678618 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:37.162098 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-24b80a94-1bc7-4aad-8092-8dcf59678618 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:37.162618 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-24b80a94-1bc7-4aad-8092-8dcf59678618 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:37.163064 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-24b80a94-1bc7-4aad-8092-8dcf59678618 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:37.163764 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-24b80a94-1bc7-4aad-8092-8dcf59678618 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:37.164228 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-24b80a94-1bc7-4aad-8092-8dcf59678618 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:37.164659 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-24b80a94-1bc7-4aad-8092-8dcf59678618 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:37.297862 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-24b80a94-1bc7-4aad-8092-8dcf59678618 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:37.307896 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-24b80a94-1bc7-4aad-8092-8dcf59678618 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:37.309122 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-24b80a94-1bc7-4aad-8092-8dcf59678618 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:37.310343 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-24b80a94-1bc7-4aad-8092-8dcf59678618 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1804 microversion: 2.20 time: 0.159088 Sep 16 09:53:37.310918 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 210/422] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:53:37 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1804 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:53:37.602758 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-6b34a7ad-b714-413d-ab37-19227b4bf01e tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:37.603372 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-6b34a7ad-b714-413d-ab37-19227b4bf01e tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] [instance: 20bade93-24eb-4e9e-8851-b3ece7eb6fed] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:37.609807 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6b34a7ad-b714-413d-ab37-19227b4bf01e tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:37.610393 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6b34a7ad-b714-413d-ab37-19227b4bf01e tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:37.612121 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6b34a7ad-b714-413d-ab37-19227b4bf01e tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:37.612394 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6b34a7ad-b714-413d-ab37-19227b4bf01e tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:37.612868 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6b34a7ad-b714-413d-ab37-19227b4bf01e tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:37.613304 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6b34a7ad-b714-413d-ab37-19227b4bf01e tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:37.751051 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-6b34a7ad-b714-413d-ab37-19227b4bf01e tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5c42006d0b442cb41952e5af6354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab67e77307d4b8f926244bc18308358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:37.759906 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-6b34a7ad-b714-413d-ab37-19227b4bf01e tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] 10.222.0.73 "GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed" status: 200 len: 1315 microversion: 2.1 time: 0.161094 Sep 16 09:53:37.760621 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 213/423] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:37 2022] GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:38.018737 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-8b7c9c08-46cc-4adb-a430-7cdfcadf878d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:38.019333 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-8b7c9c08-46cc-4adb-a430-7cdfcadf878d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:38.025249 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8b7c9c08-46cc-4adb-a430-7cdfcadf878d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:38.025764 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8b7c9c08-46cc-4adb-a430-7cdfcadf878d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:38.026207 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8b7c9c08-46cc-4adb-a430-7cdfcadf878d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:38.026971 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8b7c9c08-46cc-4adb-a430-7cdfcadf878d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:38.027435 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8b7c9c08-46cc-4adb-a430-7cdfcadf878d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:38.027860 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8b7c9c08-46cc-4adb-a430-7cdfcadf878d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:38.104231 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-03d371bc-b31a-4264-bff0-d30780262d59 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:38.104847 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-03d371bc-b31a-4264-bff0-d30780262d59 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: 60d9ad12-95e0-48c7-8db2-241f7c59cec6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:38.112815 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-03d371bc-b31a-4264-bff0-d30780262d59 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:38.113321 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-03d371bc-b31a-4264-bff0-d30780262d59 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:38.113795 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-03d371bc-b31a-4264-bff0-d30780262d59 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:38.114539 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-03d371bc-b31a-4264-bff0-d30780262d59 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:38.115001 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-03d371bc-b31a-4264-bff0-d30780262d59 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:38.115433 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-03d371bc-b31a-4264-bff0-d30780262d59 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:38.166799 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-8b7c9c08-46cc-4adb-a430-7cdfcadf878d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:38.175999 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-8b7c9c08-46cc-4adb-a430-7cdfcadf878d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa" status: 200 len: 1371 microversion: 2.1 time: 0.161715 Sep 16 09:53:38.176586 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 211/424] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:38 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:38.248599 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-03d371bc-b31a-4264-bff0-d30780262d59 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:38.256588 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-03d371bc-b31a-4264-bff0-d30780262d59 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6" status: 200 len: 1314 microversion: 2.1 time: 0.156243 Sep 16 09:53:38.257153 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 214/425] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:38 2022] GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:38.335286 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-a0ebc1a9-e6ea-4668-9d3a-a841bd832a53 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:38.335919 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-a0ebc1a9-e6ea-4668-9d3a-a841bd832a53 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:38.342031 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a0ebc1a9-e6ea-4668-9d3a-a841bd832a53 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:38.342511 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a0ebc1a9-e6ea-4668-9d3a-a841bd832a53 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:38.342942 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a0ebc1a9-e6ea-4668-9d3a-a841bd832a53 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:38.343624 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a0ebc1a9-e6ea-4668-9d3a-a841bd832a53 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:38.344074 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a0ebc1a9-e6ea-4668-9d3a-a841bd832a53 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:38.344495 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a0ebc1a9-e6ea-4668-9d3a-a841bd832a53 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:38.478327 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-a0ebc1a9-e6ea-4668-9d3a-a841bd832a53 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:38.487452 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-a0ebc1a9-e6ea-4668-9d3a-a841bd832a53 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:38.488894 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-a0ebc1a9-e6ea-4668-9d3a-a841bd832a53 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:38.490103 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-a0ebc1a9-e6ea-4668-9d3a-a841bd832a53 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1804 microversion: 2.20 time: 0.158772 Sep 16 09:53:38.490661 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 212/426] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:53:38 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1804 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:53:38.783988 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-64bd88e5-2cc3-4b4f-91d9-f2c545ff62ab tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:38.784605 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-64bd88e5-2cc3-4b4f-91d9-f2c545ff62ab tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] [instance: 20bade93-24eb-4e9e-8851-b3ece7eb6fed] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:38.791055 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-64bd88e5-2cc3-4b4f-91d9-f2c545ff62ab tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:38.791548 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-64bd88e5-2cc3-4b4f-91d9-f2c545ff62ab tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:38.791985 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-64bd88e5-2cc3-4b4f-91d9-f2c545ff62ab tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:38.792679 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-64bd88e5-2cc3-4b4f-91d9-f2c545ff62ab tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:38.793138 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-64bd88e5-2cc3-4b4f-91d9-f2c545ff62ab tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:38.793596 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-64bd88e5-2cc3-4b4f-91d9-f2c545ff62ab tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:38.923762 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-64bd88e5-2cc3-4b4f-91d9-f2c545ff62ab tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5c42006d0b442cb41952e5af6354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab67e77307d4b8f926244bc18308358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:38.932647 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-64bd88e5-2cc3-4b4f-91d9-f2c545ff62ab tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] 10.222.0.73 "GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed" status: 200 len: 1315 microversion: 2.1 time: 0.152463 Sep 16 09:53:38.933214 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 215/427] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:38 2022] GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:39.199051 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-f9369fbd-f608-46ab-a0b8-34c6a4849e7f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:39.199682 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-f9369fbd-f608-46ab-a0b8-34c6a4849e7f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:39.206924 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f9369fbd-f608-46ab-a0b8-34c6a4849e7f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:39.207445 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f9369fbd-f608-46ab-a0b8-34c6a4849e7f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:39.207894 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f9369fbd-f608-46ab-a0b8-34c6a4849e7f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:39.208625 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f9369fbd-f608-46ab-a0b8-34c6a4849e7f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:39.209091 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f9369fbd-f608-46ab-a0b8-34c6a4849e7f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:39.209521 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f9369fbd-f608-46ab-a0b8-34c6a4849e7f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:39.279357 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-02db935b-b784-474b-8e52-f53a2ab394ff tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:39.280122 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-02db935b-b784-474b-8e52-f53a2ab394ff tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: 60d9ad12-95e0-48c7-8db2-241f7c59cec6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:39.287773 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-02db935b-b784-474b-8e52-f53a2ab394ff tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:39.288297 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-02db935b-b784-474b-8e52-f53a2ab394ff tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:39.288740 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-02db935b-b784-474b-8e52-f53a2ab394ff tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:39.289449 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-02db935b-b784-474b-8e52-f53a2ab394ff tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:39.290093 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-02db935b-b784-474b-8e52-f53a2ab394ff tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:39.290529 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-02db935b-b784-474b-8e52-f53a2ab394ff tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:39.374431 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-f9369fbd-f608-46ab-a0b8-34c6a4849e7f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:39.382567 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-f9369fbd-f608-46ab-a0b8-34c6a4849e7f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa" status: 200 len: 1371 microversion: 2.1 time: 0.187416 Sep 16 09:53:39.398111 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 213/428] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:39 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa => generated 1371 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:39.447402 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-02db935b-b784-474b-8e52-f53a2ab394ff tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:39.456392 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-02db935b-b784-474b-8e52-f53a2ab394ff tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6" status: 200 len: 1314 microversion: 2.1 time: 0.180884 Sep 16 09:53:39.457357 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 216/429] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:39 2022] GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:53:39.516065 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-92b3c0e2-b12e-4d2f-8f6f-4ae3d4346a14 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:39.517028 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-92b3c0e2-b12e-4d2f-8f6f-4ae3d4346a14 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:39.522930 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-92b3c0e2-b12e-4d2f-8f6f-4ae3d4346a14 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:39.523418 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-92b3c0e2-b12e-4d2f-8f6f-4ae3d4346a14 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:39.523852 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-92b3c0e2-b12e-4d2f-8f6f-4ae3d4346a14 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:39.524548 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-92b3c0e2-b12e-4d2f-8f6f-4ae3d4346a14 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:39.525001 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-92b3c0e2-b12e-4d2f-8f6f-4ae3d4346a14 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:39.525423 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-92b3c0e2-b12e-4d2f-8f6f-4ae3d4346a14 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:39.700271 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-92b3c0e2-b12e-4d2f-8f6f-4ae3d4346a14 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:39.709788 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-92b3c0e2-b12e-4d2f-8f6f-4ae3d4346a14 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:39.711522 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-92b3c0e2-b12e-4d2f-8f6f-4ae3d4346a14 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:39.712925 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-92b3c0e2-b12e-4d2f-8f6f-4ae3d4346a14 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1804 microversion: 2.20 time: 0.201676 Sep 16 09:53:39.713665 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 214/430] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:53:39 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1804 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:53:39.955702 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-dd47d126-b5e6-4aff-854a-7fd600c44a00 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:39.956323 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-dd47d126-b5e6-4aff-854a-7fd600c44a00 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] [instance: 20bade93-24eb-4e9e-8851-b3ece7eb6fed] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:39.962454 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dd47d126-b5e6-4aff-854a-7fd600c44a00 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:39.962953 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dd47d126-b5e6-4aff-854a-7fd600c44a00 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:39.963396 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dd47d126-b5e6-4aff-854a-7fd600c44a00 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:39.964094 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dd47d126-b5e6-4aff-854a-7fd600c44a00 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:39.964557 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dd47d126-b5e6-4aff-854a-7fd600c44a00 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:39.964991 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dd47d126-b5e6-4aff-854a-7fd600c44a00 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:40.123757 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-dd47d126-b5e6-4aff-854a-7fd600c44a00 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5c42006d0b442cb41952e5af6354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab67e77307d4b8f926244bc18308358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:40.135851 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-dd47d126-b5e6-4aff-854a-7fd600c44a00 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] 10.222.0.73 "GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed" status: 200 len: 1315 microversion: 2.1 time: 0.181459 Sep 16 09:53:40.135851 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 217/431] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:39 2022] GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:40.406194 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-8b746a35-c449-4cf7-8d75-0da03366a1f4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:40.406804 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-8b746a35-c449-4cf7-8d75-0da03366a1f4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:40.423662 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8b746a35-c449-4cf7-8d75-0da03366a1f4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:40.423662 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8b746a35-c449-4cf7-8d75-0da03366a1f4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:40.423662 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8b746a35-c449-4cf7-8d75-0da03366a1f4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:40.423662 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8b746a35-c449-4cf7-8d75-0da03366a1f4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:40.424045 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8b746a35-c449-4cf7-8d75-0da03366a1f4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:40.424045 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8b746a35-c449-4cf7-8d75-0da03366a1f4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:40.480217 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-ac0c2a21-7b2a-464c-9345-83efebd38f48 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:40.481492 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-ac0c2a21-7b2a-464c-9345-83efebd38f48 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: 60d9ad12-95e0-48c7-8db2-241f7c59cec6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:40.490274 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ac0c2a21-7b2a-464c-9345-83efebd38f48 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:40.490788 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ac0c2a21-7b2a-464c-9345-83efebd38f48 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:40.491231 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ac0c2a21-7b2a-464c-9345-83efebd38f48 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:40.491941 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ac0c2a21-7b2a-464c-9345-83efebd38f48 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:40.492417 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ac0c2a21-7b2a-464c-9345-83efebd38f48 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:40.492844 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ac0c2a21-7b2a-464c-9345-83efebd38f48 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:40.594144 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-8b746a35-c449-4cf7-8d75-0da03366a1f4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:40.595687 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell1:SELECT=100 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:53:40.601349 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-8b746a35-c449-4cf7-8d75-0da03366a1f4 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa" status: 200 len: 1371 microversion: 2.1 time: 0.198828 Sep 16 09:53:40.602166 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 215/432] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:40 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa => generated 1371 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:40.646000 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-ac0c2a21-7b2a-464c-9345-83efebd38f48 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:40.654456 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-ac0c2a21-7b2a-464c-9345-83efebd38f48 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6" status: 200 len: 1314 microversion: 2.1 time: 0.178223 Sep 16 09:53:40.655197 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 218/433] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:40 2022] GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:53:40.746156 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-d17d4d1a-32a4-493b-a85b-4161d4300d03 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:40.748235 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-d17d4d1a-32a4-493b-a85b-4161d4300d03 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:40.755756 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d17d4d1a-32a4-493b-a85b-4161d4300d03 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:40.758392 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d17d4d1a-32a4-493b-a85b-4161d4300d03 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:40.758888 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d17d4d1a-32a4-493b-a85b-4161d4300d03 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:40.759738 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d17d4d1a-32a4-493b-a85b-4161d4300d03 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:40.760266 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d17d4d1a-32a4-493b-a85b-4161d4300d03 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:40.760772 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d17d4d1a-32a4-493b-a85b-4161d4300d03 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:40.964563 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-d17d4d1a-32a4-493b-a85b-4161d4300d03 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:40.973423 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-d17d4d1a-32a4-493b-a85b-4161d4300d03 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:40.975633 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-d17d4d1a-32a4-493b-a85b-4161d4300d03 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:40.978025 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-d17d4d1a-32a4-493b-a85b-4161d4300d03 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1804 microversion: 2.20 time: 0.240256 Sep 16 09:53:40.978025 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 216/434] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:53:40 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1804 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:53:41.156346 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-c1d3c433-658e-49d7-be88-aa930a854098 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:41.156955 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-c1d3c433-658e-49d7-be88-aa930a854098 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] [instance: 20bade93-24eb-4e9e-8851-b3ece7eb6fed] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:41.164238 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c1d3c433-658e-49d7-be88-aa930a854098 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:41.164574 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c1d3c433-658e-49d7-be88-aa930a854098 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:41.164991 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c1d3c433-658e-49d7-be88-aa930a854098 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:41.165762 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c1d3c433-658e-49d7-be88-aa930a854098 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:41.166222 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c1d3c433-658e-49d7-be88-aa930a854098 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:41.166645 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c1d3c433-658e-49d7-be88-aa930a854098 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:41.312046 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c1d3c433-658e-49d7-be88-aa930a854098 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5c42006d0b442cb41952e5af6354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab67e77307d4b8f926244bc18308358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:41.324489 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-c1d3c433-658e-49d7-be88-aa930a854098 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] 10.222.0.73 "GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed" status: 200 len: 1315 microversion: 2.1 time: 0.171830 Sep 16 09:53:41.325252 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 219/435] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:41 2022] GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:41.371623 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [req-bfd92743-8c55-4f9a-abd7-e2bdc9965700 req-8f051bc6-b307-4213-a6a9-d7c3311d516c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20bade93-24eb-4e9e-8851-b3ece7eb6fed", "name": "network-vif-plugged", "status": "completed", "tag": "4302a618-12ca-4b92-bc76-2b29994a3581"}]} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:53:41.383360 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-bfd92743-8c55-4f9a-abd7-e2bdc9965700 req-8f051bc6-b307-4213-a6a9-d7c3311d516c service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:41.383997 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-bfd92743-8c55-4f9a-abd7-e2bdc9965700 req-8f051bc6-b307-4213-a6a9-d7c3311d516c service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:41.384614 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-bfd92743-8c55-4f9a-abd7-e2bdc9965700 req-8f051bc6-b307-4213-a6a9-d7c3311d516c service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:41.396414 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.compute.server_external_events [req-bfd92743-8c55-4f9a-abd7-e2bdc9965700 req-8f051bc6-b307-4213-a6a9-d7c3311d516c service nova] Creating event network-vif-plugged:4302a618-12ca-4b92-bc76-2b29994a3581 for instance 20bade93-24eb-4e9e-8851-b3ece7eb6fed on hv-cinder-79053 Sep 16 09:53:41.401900 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [req-bfd92743-8c55-4f9a-abd7-e2bdc9965700 req-8f051bc6-b307-4213-a6a9-d7c3311d516c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034589 Sep 16 09:53:41.402677 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 217/436] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:53:41.625827 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-03d4e1bd-3b6a-4d65-a5ce-666e67b32adc tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:41.626451 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-03d4e1bd-3b6a-4d65-a5ce-666e67b32adc tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:41.633699 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-03d4e1bd-3b6a-4d65-a5ce-666e67b32adc tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:41.634198 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-03d4e1bd-3b6a-4d65-a5ce-666e67b32adc tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:41.634649 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-03d4e1bd-3b6a-4d65-a5ce-666e67b32adc tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:41.635347 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-03d4e1bd-3b6a-4d65-a5ce-666e67b32adc tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:41.635858 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-03d4e1bd-3b6a-4d65-a5ce-666e67b32adc tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:41.636291 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-03d4e1bd-3b6a-4d65-a5ce-666e67b32adc tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:41.678772 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-ca0eac34-9e46-4731-840f-66c567d88c7f tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:41.679596 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-ca0eac34-9e46-4731-840f-66c567d88c7f tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: 60d9ad12-95e0-48c7-8db2-241f7c59cec6] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:41.686173 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ca0eac34-9e46-4731-840f-66c567d88c7f tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:41.687372 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ca0eac34-9e46-4731-840f-66c567d88c7f tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:41.687372 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ca0eac34-9e46-4731-840f-66c567d88c7f tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:41.687762 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ca0eac34-9e46-4731-840f-66c567d88c7f tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:41.688214 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ca0eac34-9e46-4731-840f-66c567d88c7f tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:41.688656 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ca0eac34-9e46-4731-840f-66c567d88c7f tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:41.781476 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-03d4e1bd-3b6a-4d65-a5ce-666e67b32adc tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:41.790933 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-03d4e1bd-3b6a-4d65-a5ce-666e67b32adc tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa" status: 200 len: 1564 microversion: 2.1 time: 0.169045 Sep 16 09:53:41.791546 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 220/437] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:41 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa => generated 1564 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:41.814648 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-df69320b-ad93-4963-8bce-5819a27c237a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:41.815139 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-df69320b-ad93-4963-8bce-5819a27c237a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:41.822356 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-df69320b-ad93-4963-8bce-5819a27c237a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:41.824322 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-df69320b-ad93-4963-8bce-5819a27c237a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:41.824322 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-df69320b-ad93-4963-8bce-5819a27c237a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:41.824322 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-df69320b-ad93-4963-8bce-5819a27c237a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:41.824569 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-df69320b-ad93-4963-8bce-5819a27c237a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:41.824842 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-df69320b-ad93-4963-8bce-5819a27c237a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:41.839399 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-ca0eac34-9e46-4731-840f-66c567d88c7f tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:41.848598 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-ca0eac34-9e46-4731-840f-66c567d88c7f tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6" status: 200 len: 1314 microversion: 2.1 time: 0.174577 Sep 16 09:53:41.849433 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 218/438] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:41 2022] GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:41.916110 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-df69320b-ad93-4963-8bce-5819a27c237a tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105680 Sep 16 09:53:41.916908 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 221/439] 10.222.0.73 () {58 vars in 1275 bytes} [Fri Sep 16 09:53:41 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 09:53:42.005622 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-ab7bbb2f-796e-4556-9b9f-fdf2c15f1105 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:42.006297 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-ab7bbb2f-796e-4556-9b9f-fdf2c15f1105 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:42.013110 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ab7bbb2f-796e-4556-9b9f-fdf2c15f1105 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:42.013635 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ab7bbb2f-796e-4556-9b9f-fdf2c15f1105 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:42.014465 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ab7bbb2f-796e-4556-9b9f-fdf2c15f1105 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:42.015826 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ab7bbb2f-796e-4556-9b9f-fdf2c15f1105 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:42.016624 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ab7bbb2f-796e-4556-9b9f-fdf2c15f1105 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:42.017227 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ab7bbb2f-796e-4556-9b9f-fdf2c15f1105 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:42.198738 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-ab7bbb2f-796e-4556-9b9f-fdf2c15f1105 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:42.208392 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-ab7bbb2f-796e-4556-9b9f-fdf2c15f1105 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:42.209876 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-ab7bbb2f-796e-4556-9b9f-fdf2c15f1105 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:42.211205 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-ab7bbb2f-796e-4556-9b9f-fdf2c15f1105 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1804 microversion: 2.20 time: 0.210627 Sep 16 09:53:42.211760 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 219/440] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:53:41 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1804 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:53:42.348789 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-ed014ecd-c382-4823-94c0-f7ce565c1728 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:42.349428 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-ed014ecd-c382-4823-94c0-f7ce565c1728 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] [instance: 20bade93-24eb-4e9e-8851-b3ece7eb6fed] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:42.359910 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ed014ecd-c382-4823-94c0-f7ce565c1728 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:42.360780 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ed014ecd-c382-4823-94c0-f7ce565c1728 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:42.361414 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ed014ecd-c382-4823-94c0-f7ce565c1728 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:42.362761 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ed014ecd-c382-4823-94c0-f7ce565c1728 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:42.369745 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ed014ecd-c382-4823-94c0-f7ce565c1728 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:42.370885 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ed014ecd-c382-4823-94c0-f7ce565c1728 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:42.569159 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-ed014ecd-c382-4823-94c0-f7ce565c1728 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5c42006d0b442cb41952e5af6354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab67e77307d4b8f926244bc18308358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:42.576928 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-ed014ecd-c382-4823-94c0-f7ce565c1728 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] 10.222.0.73 "GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed" status: 200 len: 1315 microversion: 2.1 time: 0.232514 Sep 16 09:53:42.577407 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 222/441] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:42 2022] GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:42.879576 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-87363af5-9c09-4d74-8f64-91545b51790f tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:42.884266 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-87363af5-9c09-4d74-8f64-91545b51790f tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: 60d9ad12-95e0-48c7-8db2-241f7c59cec6] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:42.891315 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-87363af5-9c09-4d74-8f64-91545b51790f tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:42.891903 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-87363af5-9c09-4d74-8f64-91545b51790f tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:42.902231 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-87363af5-9c09-4d74-8f64-91545b51790f tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:42.903415 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-87363af5-9c09-4d74-8f64-91545b51790f tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:42.903988 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-87363af5-9c09-4d74-8f64-91545b51790f tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:42.904599 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-87363af5-9c09-4d74-8f64-91545b51790f tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:43.148041 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-87363af5-9c09-4d74-8f64-91545b51790f tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:43.160830 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-87363af5-9c09-4d74-8f64-91545b51790f tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6" status: 200 len: 1314 microversion: 2.1 time: 0.286689 Sep 16 09:53:43.161989 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 220/442] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:42 2022] GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6 => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:43.237917 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-4119e57c-114f-4f2e-b466-10e65d399de7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:43.239124 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-4119e57c-114f-4f2e-b466-10e65d399de7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:43.246602 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4119e57c-114f-4f2e-b466-10e65d399de7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:43.247418 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4119e57c-114f-4f2e-b466-10e65d399de7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:43.248077 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4119e57c-114f-4f2e-b466-10e65d399de7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:43.249077 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4119e57c-114f-4f2e-b466-10e65d399de7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:43.249750 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4119e57c-114f-4f2e-b466-10e65d399de7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:43.250364 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4119e57c-114f-4f2e-b466-10e65d399de7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:43.421328 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [req-c158a657-12fd-4e5b-8ded-229bd72174fa req-92118a06-de7b-4c6f-82b7-e9a5fef8af54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60d9ad12-95e0-48c7-8db2-241f7c59cec6", "name": "network-vif-plugged", "status": "completed", "tag": "e2f73010-dd79-4f94-88e0-b0b0a4af8ed6"}]} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:53:43.433504 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-c158a657-12fd-4e5b-8ded-229bd72174fa req-92118a06-de7b-4c6f-82b7-e9a5fef8af54 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:43.435134 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-c158a657-12fd-4e5b-8ded-229bd72174fa req-92118a06-de7b-4c6f-82b7-e9a5fef8af54 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:43.435757 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-c158a657-12fd-4e5b-8ded-229bd72174fa req-92118a06-de7b-4c6f-82b7-e9a5fef8af54 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:43.478567 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.compute.server_external_events [req-c158a657-12fd-4e5b-8ded-229bd72174fa req-92118a06-de7b-4c6f-82b7-e9a5fef8af54 service nova] Creating event network-vif-plugged:e2f73010-dd79-4f94-88e0-b0b0a4af8ed6 for instance 60d9ad12-95e0-48c7-8db2-241f7c59cec6 on hv-cinder-79053 Sep 16 09:53:43.486452 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [req-c158a657-12fd-4e5b-8ded-229bd72174fa req-92118a06-de7b-4c6f-82b7-e9a5fef8af54 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067054 Sep 16 09:53:43.492952 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 221/443] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 09:53:43.532376 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [req-913b0204-f94f-4700-9478-befe0a749dfb req-3daafc08-5a56-493e-9ecc-2e335d317d8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa", "tag": "6851d923-796f-41a3-a0d3-de42390996fa"}]} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:53:43.535970 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-4119e57c-114f-4f2e-b466-10e65d399de7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:43.545547 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-4119e57c-114f-4f2e-b466-10e65d399de7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:43.547090 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-4119e57c-114f-4f2e-b466-10e65d399de7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:43.548172 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-913b0204-f94f-4700-9478-befe0a749dfb req-3daafc08-5a56-493e-9ecc-2e335d317d8d service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:43.548865 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-913b0204-f94f-4700-9478-befe0a749dfb req-3daafc08-5a56-493e-9ecc-2e335d317d8d service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:43.549562 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-913b0204-f94f-4700-9478-befe0a749dfb req-3daafc08-5a56-493e-9ecc-2e335d317d8d service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:43.550529 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-4119e57c-114f-4f2e-b466-10e65d399de7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1804 microversion: 2.20 time: 0.316146 Sep 16 09:53:43.551457 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 223/444] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:53:43 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1804 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 09:53:43.587011 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.compute.server_external_events [req-913b0204-f94f-4700-9478-befe0a749dfb req-3daafc08-5a56-493e-9ecc-2e335d317d8d service nova] Creating event network-changed:6851d923-796f-41a3-a0d3-de42390996fa for instance bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa on hv-cinder-79053 Sep 16 09:53:43.592916 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [req-913b0204-f94f-4700-9478-befe0a749dfb req-3daafc08-5a56-493e-9ecc-2e335d317d8d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066522 Sep 16 09:53:43.593879 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 222/445] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:53:43.601018 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-bb21c8f5-4796-490d-882c-ad42a598605b tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:43.601759 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-bb21c8f5-4796-490d-882c-ad42a598605b tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] [instance: 20bade93-24eb-4e9e-8851-b3ece7eb6fed] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:43.608769 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bb21c8f5-4796-490d-882c-ad42a598605b tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:43.609181 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bb21c8f5-4796-490d-882c-ad42a598605b tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:43.609846 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bb21c8f5-4796-490d-882c-ad42a598605b tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:43.610825 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bb21c8f5-4796-490d-882c-ad42a598605b tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:43.611292 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bb21c8f5-4796-490d-882c-ad42a598605b tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:43.611754 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bb21c8f5-4796-490d-882c-ad42a598605b tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:43.769020 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-bb21c8f5-4796-490d-882c-ad42a598605b tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5c42006d0b442cb41952e5af6354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab67e77307d4b8f926244bc18308358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:43.779677 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-bb21c8f5-4796-490d-882c-ad42a598605b tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] 10.222.0.73 "GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed" status: 200 len: 1315 microversion: 2.1 time: 0.183981 Sep 16 09:53:43.780297 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 224/446] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:43 2022] GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:53:44.187844 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-88b91c0e-639a-4aa0-b8b9-265fd4b43673 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:44.189401 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-88b91c0e-639a-4aa0-b8b9-265fd4b43673 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: 60d9ad12-95e0-48c7-8db2-241f7c59cec6] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:44.205426 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-88b91c0e-639a-4aa0-b8b9-265fd4b43673 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:44.206057 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-88b91c0e-639a-4aa0-b8b9-265fd4b43673 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:44.207127 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-88b91c0e-639a-4aa0-b8b9-265fd4b43673 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:44.207872 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-88b91c0e-639a-4aa0-b8b9-265fd4b43673 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:44.208342 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-88b91c0e-639a-4aa0-b8b9-265fd4b43673 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:44.208783 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-88b91c0e-639a-4aa0-b8b9-265fd4b43673 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:44.413299 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-88b91c0e-639a-4aa0-b8b9-265fd4b43673 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:44.424346 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-88b91c0e-639a-4aa0-b8b9-265fd4b43673 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6" status: 200 len: 1314 microversion: 2.1 time: 0.240823 Sep 16 09:53:44.425857 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 223/447] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:44 2022] GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:44.579661 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-eb908f24-6935-4f1d-aa01-e5d88a82e875 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:44.584993 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-eb908f24-6935-4f1d-aa01-e5d88a82e875 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:44.595525 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:53:44.598239 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-eb908f24-6935-4f1d-aa01-e5d88a82e875 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:44.599359 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-eb908f24-6935-4f1d-aa01-e5d88a82e875 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:44.600145 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-eb908f24-6935-4f1d-aa01-e5d88a82e875 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:44.606715 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-eb908f24-6935-4f1d-aa01-e5d88a82e875 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:44.607338 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-eb908f24-6935-4f1d-aa01-e5d88a82e875 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:44.607846 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-eb908f24-6935-4f1d-aa01-e5d88a82e875 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:44.808219 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-72cc1064-8158-4341-a1a2-abae8136fbdc tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:44.809484 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-72cc1064-8158-4341-a1a2-abae8136fbdc tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] [instance: 20bade93-24eb-4e9e-8851-b3ece7eb6fed] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:44.817287 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-72cc1064-8158-4341-a1a2-abae8136fbdc tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:44.823033 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-72cc1064-8158-4341-a1a2-abae8136fbdc tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:44.823617 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-72cc1064-8158-4341-a1a2-abae8136fbdc tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:44.824379 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-72cc1064-8158-4341-a1a2-abae8136fbdc tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:44.832282 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-72cc1064-8158-4341-a1a2-abae8136fbdc tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:44.832282 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-72cc1064-8158-4341-a1a2-abae8136fbdc tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:44.906911 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-eb908f24-6935-4f1d-aa01-e5d88a82e875 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:44.936586 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-eb908f24-6935-4f1d-aa01-e5d88a82e875 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:44.938373 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-eb908f24-6935-4f1d-aa01-e5d88a82e875 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:44.939813 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-eb908f24-6935-4f1d-aa01-e5d88a82e875 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1804 microversion: 2.20 time: 0.365375 Sep 16 09:53:44.941412 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 225/448] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:53:44 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1804 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:53:45.080729 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-72cc1064-8158-4341-a1a2-abae8136fbdc tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5c42006d0b442cb41952e5af6354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab67e77307d4b8f926244bc18308358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:45.094151 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-72cc1064-8158-4341-a1a2-abae8136fbdc tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] 10.222.0.73 "GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed" status: 200 len: 1315 microversion: 2.1 time: 0.290679 Sep 16 09:53:45.109568 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 224/449] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:44 2022] GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:53:45.448611 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-2894fc3f-6563-408f-881e-156d09f69411 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:45.449444 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-2894fc3f-6563-408f-881e-156d09f69411 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: 60d9ad12-95e0-48c7-8db2-241f7c59cec6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:45.461371 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2894fc3f-6563-408f-881e-156d09f69411 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:45.462377 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2894fc3f-6563-408f-881e-156d09f69411 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:45.463343 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2894fc3f-6563-408f-881e-156d09f69411 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:45.464330 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2894fc3f-6563-408f-881e-156d09f69411 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:45.465130 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2894fc3f-6563-408f-881e-156d09f69411 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:45.465804 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2894fc3f-6563-408f-881e-156d09f69411 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:45.648700 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-2894fc3f-6563-408f-881e-156d09f69411 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:45.652275 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=100 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:53:45.661077 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-2894fc3f-6563-408f-881e-156d09f69411 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6" status: 200 len: 1314 microversion: 2.1 time: 0.216989 Sep 16 09:53:45.668953 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 226/450] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:45 2022] GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:45.974590 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-9368d3a0-976f-4177-bbbd-e9d4b684ea66 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:45.975209 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-9368d3a0-976f-4177-bbbd-e9d4b684ea66 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:45.986034 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9368d3a0-976f-4177-bbbd-e9d4b684ea66 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:45.986816 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9368d3a0-976f-4177-bbbd-e9d4b684ea66 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:45.987454 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9368d3a0-976f-4177-bbbd-e9d4b684ea66 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:45.988524 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9368d3a0-976f-4177-bbbd-e9d4b684ea66 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:45.989496 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9368d3a0-976f-4177-bbbd-e9d4b684ea66 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:45.990108 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9368d3a0-976f-4177-bbbd-e9d4b684ea66 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:46.125489 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-a8c63d7e-1681-401f-b956-4934f5570cea tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:46.126451 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-a8c63d7e-1681-401f-b956-4934f5570cea tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] [instance: 20bade93-24eb-4e9e-8851-b3ece7eb6fed] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:46.140357 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a8c63d7e-1681-401f-b956-4934f5570cea tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:46.141153 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a8c63d7e-1681-401f-b956-4934f5570cea tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:46.142373 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a8c63d7e-1681-401f-b956-4934f5570cea tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:46.145357 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a8c63d7e-1681-401f-b956-4934f5570cea tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:46.145357 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a8c63d7e-1681-401f-b956-4934f5570cea tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:46.145357 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a8c63d7e-1681-401f-b956-4934f5570cea tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:46.178504 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-9368d3a0-976f-4177-bbbd-e9d4b684ea66 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:46.192385 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-9368d3a0-976f-4177-bbbd-e9d4b684ea66 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:46.194036 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-9368d3a0-976f-4177-bbbd-e9d4b684ea66 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:46.195485 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-9368d3a0-976f-4177-bbbd-e9d4b684ea66 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1804 microversion: 2.20 time: 0.228059 Sep 16 09:53:46.208102 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 225/451] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:53:45 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1804 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:53:46.331888 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-a8c63d7e-1681-401f-b956-4934f5570cea tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5c42006d0b442cb41952e5af6354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab67e77307d4b8f926244bc18308358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:46.340644 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-a8c63d7e-1681-401f-b956-4934f5570cea tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] 10.222.0.73 "GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed" status: 200 len: 1315 microversion: 2.1 time: 0.221119 Sep 16 09:53:46.341480 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 227/452] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:46 2022] GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:46.684833 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-04aaff7f-98f0-4b1f-99e7-187b603c8f91 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:46.685485 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-04aaff7f-98f0-4b1f-99e7-187b603c8f91 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: 60d9ad12-95e0-48c7-8db2-241f7c59cec6] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:46.694085 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-04aaff7f-98f0-4b1f-99e7-187b603c8f91 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:46.694659 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-04aaff7f-98f0-4b1f-99e7-187b603c8f91 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:46.695185 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-04aaff7f-98f0-4b1f-99e7-187b603c8f91 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:46.695963 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-04aaff7f-98f0-4b1f-99e7-187b603c8f91 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:46.696525 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-04aaff7f-98f0-4b1f-99e7-187b603c8f91 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:46.697044 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-04aaff7f-98f0-4b1f-99e7-187b603c8f91 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:46.973205 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-04aaff7f-98f0-4b1f-99e7-187b603c8f91 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:46.985147 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-04aaff7f-98f0-4b1f-99e7-187b603c8f91 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6" status: 200 len: 1314 microversion: 2.1 time: 0.300912 Sep 16 09:53:46.987066 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 226/453] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:46 2022] GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6 => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:47.227056 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-a09a36e6-18b3-45cb-971a-aad39b5dff9a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:47.227687 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-a09a36e6-18b3-45cb-971a-aad39b5dff9a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:47.243075 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a09a36e6-18b3-45cb-971a-aad39b5dff9a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:47.243819 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a09a36e6-18b3-45cb-971a-aad39b5dff9a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:47.244439 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a09a36e6-18b3-45cb-971a-aad39b5dff9a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:47.245480 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a09a36e6-18b3-45cb-971a-aad39b5dff9a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:47.246119 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a09a36e6-18b3-45cb-971a-aad39b5dff9a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:47.246702 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a09a36e6-18b3-45cb-971a-aad39b5dff9a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:47.364646 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-da02186a-389a-491e-b3eb-793684e0a19b tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:47.365257 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-da02186a-389a-491e-b3eb-793684e0a19b tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] [instance: 20bade93-24eb-4e9e-8851-b3ece7eb6fed] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:47.372084 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-da02186a-389a-491e-b3eb-793684e0a19b tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:47.372578 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-da02186a-389a-491e-b3eb-793684e0a19b tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:47.373018 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-da02186a-389a-491e-b3eb-793684e0a19b tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:47.373759 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-da02186a-389a-491e-b3eb-793684e0a19b tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:47.374396 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-da02186a-389a-491e-b3eb-793684e0a19b tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:47.374979 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-da02186a-389a-491e-b3eb-793684e0a19b tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:47.529357 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-a09a36e6-18b3-45cb-971a-aad39b5dff9a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:47.539158 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-a09a36e6-18b3-45cb-971a-aad39b5dff9a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:47.541287 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-a09a36e6-18b3-45cb-971a-aad39b5dff9a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:47.542935 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-a09a36e6-18b3-45cb-971a-aad39b5dff9a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1804 microversion: 2.20 time: 0.322164 Sep 16 09:53:47.544068 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 228/454] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:53:47 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1804 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:53:47.611611 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-da02186a-389a-491e-b3eb-793684e0a19b tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5c42006d0b442cb41952e5af6354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab67e77307d4b8f926244bc18308358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:47.626276 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-da02186a-389a-491e-b3eb-793684e0a19b tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] 10.222.0.73 "GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed" status: 200 len: 1315 microversion: 2.1 time: 0.265863 Sep 16 09:53:47.627098 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 227/455] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:47 2022] GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:53:48.010035 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d5cd0eab-7eac-41d1-814d-1626ad8b98ac tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:48.010798 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-d5cd0eab-7eac-41d1-814d-1626ad8b98ac tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: 60d9ad12-95e0-48c7-8db2-241f7c59cec6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:48.019184 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d5cd0eab-7eac-41d1-814d-1626ad8b98ac tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:48.019608 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d5cd0eab-7eac-41d1-814d-1626ad8b98ac tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:48.020147 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d5cd0eab-7eac-41d1-814d-1626ad8b98ac tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:48.020909 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d5cd0eab-7eac-41d1-814d-1626ad8b98ac tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:48.021495 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d5cd0eab-7eac-41d1-814d-1626ad8b98ac tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:48.021962 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d5cd0eab-7eac-41d1-814d-1626ad8b98ac tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:48.210500 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-d5cd0eab-7eac-41d1-814d-1626ad8b98ac tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:48.224625 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-d5cd0eab-7eac-41d1-814d-1626ad8b98ac tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6" status: 200 len: 1314 microversion: 2.1 time: 0.218487 Sep 16 09:53:48.229623 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 229/456] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:48 2022] GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:48.574460 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-2c945bd9-f0fc-4fe0-b86b-8a2aeaf26e6d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:48.575714 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-2c945bd9-f0fc-4fe0-b86b-8a2aeaf26e6d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:48.583392 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2c945bd9-f0fc-4fe0-b86b-8a2aeaf26e6d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:48.584220 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2c945bd9-f0fc-4fe0-b86b-8a2aeaf26e6d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:48.584874 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2c945bd9-f0fc-4fe0-b86b-8a2aeaf26e6d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:48.585823 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2c945bd9-f0fc-4fe0-b86b-8a2aeaf26e6d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:48.586492 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2c945bd9-f0fc-4fe0-b86b-8a2aeaf26e6d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:48.586996 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2c945bd9-f0fc-4fe0-b86b-8a2aeaf26e6d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:48.649745 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-a5ba6a8f-ac94-45e1-833b-6a8c2351ef8a tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:48.650643 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-a5ba6a8f-ac94-45e1-833b-6a8c2351ef8a tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] [instance: 20bade93-24eb-4e9e-8851-b3ece7eb6fed] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:48.662556 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a5ba6a8f-ac94-45e1-833b-6a8c2351ef8a tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:48.663056 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a5ba6a8f-ac94-45e1-833b-6a8c2351ef8a tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:48.663493 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a5ba6a8f-ac94-45e1-833b-6a8c2351ef8a tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:48.664583 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a5ba6a8f-ac94-45e1-833b-6a8c2351ef8a tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:48.665201 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a5ba6a8f-ac94-45e1-833b-6a8c2351ef8a tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:48.665807 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a5ba6a8f-ac94-45e1-833b-6a8c2351ef8a tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:48.779241 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-2c945bd9-f0fc-4fe0-b86b-8a2aeaf26e6d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:48.789040 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-2c945bd9-f0fc-4fe0-b86b-8a2aeaf26e6d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:48.790870 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-2c945bd9-f0fc-4fe0-b86b-8a2aeaf26e6d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:48.792236 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-2c945bd9-f0fc-4fe0-b86b-8a2aeaf26e6d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1804 microversion: 2.20 time: 0.222862 Sep 16 09:53:48.806344 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 228/457] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:53:48 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1804 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:53:49.124743 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-a5ba6a8f-ac94-45e1-833b-6a8c2351ef8a tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5c42006d0b442cb41952e5af6354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab67e77307d4b8f926244bc18308358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:49.137968 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-a5ba6a8f-ac94-45e1-833b-6a8c2351ef8a tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] 10.222.0.73 "GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed" status: 200 len: 1315 microversion: 2.1 time: 0.491872 Sep 16 09:53:49.141530 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 230/458] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:48 2022] GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed => generated 1315 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:49.248873 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-be34c4a9-b27f-4ddb-9139-98f024403e4b tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:49.249894 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-be34c4a9-b27f-4ddb-9139-98f024403e4b tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: 60d9ad12-95e0-48c7-8db2-241f7c59cec6] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:49.257296 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-be34c4a9-b27f-4ddb-9139-98f024403e4b tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:49.258169 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-be34c4a9-b27f-4ddb-9139-98f024403e4b tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:49.259097 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-be34c4a9-b27f-4ddb-9139-98f024403e4b tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:49.260035 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-be34c4a9-b27f-4ddb-9139-98f024403e4b tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:49.260603 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-be34c4a9-b27f-4ddb-9139-98f024403e4b tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:49.261133 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-be34c4a9-b27f-4ddb-9139-98f024403e4b tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:49.423632 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-be34c4a9-b27f-4ddb-9139-98f024403e4b tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:49.432832 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-be34c4a9-b27f-4ddb-9139-98f024403e4b tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6" status: 200 len: 1314 microversion: 2.1 time: 0.188255 Sep 16 09:53:49.434755 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 229/459] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:49 2022] GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:49.818729 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-32a9b08d-9054-4cd6-99df-dc4af67719bd tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:49.819294 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-32a9b08d-9054-4cd6-99df-dc4af67719bd tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:49.825804 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-32a9b08d-9054-4cd6-99df-dc4af67719bd tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:49.826260 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-32a9b08d-9054-4cd6-99df-dc4af67719bd tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:49.826702 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-32a9b08d-9054-4cd6-99df-dc4af67719bd tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:49.827424 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-32a9b08d-9054-4cd6-99df-dc4af67719bd tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:49.827888 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-32a9b08d-9054-4cd6-99df-dc4af67719bd tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:49.828317 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-32a9b08d-9054-4cd6-99df-dc4af67719bd tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:49.987991 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-32a9b08d-9054-4cd6-99df-dc4af67719bd tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:50.003134 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-32a9b08d-9054-4cd6-99df-dc4af67719bd tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:50.004632 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-32a9b08d-9054-4cd6-99df-dc4af67719bd tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:50.005889 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-32a9b08d-9054-4cd6-99df-dc4af67719bd tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1804 microversion: 2.20 time: 0.191280 Sep 16 09:53:50.007388 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 231/460] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:53:49 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1804 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:53:50.163468 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-9f41ee20-9acb-4c3f-b0e3-4943e78286f6 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:50.164737 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-9f41ee20-9acb-4c3f-b0e3-4943e78286f6 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] [instance: 20bade93-24eb-4e9e-8851-b3ece7eb6fed] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:50.171473 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9f41ee20-9acb-4c3f-b0e3-4943e78286f6 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:50.172442 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9f41ee20-9acb-4c3f-b0e3-4943e78286f6 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:50.173151 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9f41ee20-9acb-4c3f-b0e3-4943e78286f6 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:50.174126 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9f41ee20-9acb-4c3f-b0e3-4943e78286f6 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:50.174932 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9f41ee20-9acb-4c3f-b0e3-4943e78286f6 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:50.175758 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9f41ee20-9acb-4c3f-b0e3-4943e78286f6 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:50.332929 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-9f41ee20-9acb-4c3f-b0e3-4943e78286f6 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5c42006d0b442cb41952e5af6354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab67e77307d4b8f926244bc18308358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:50.340987 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-9f41ee20-9acb-4c3f-b0e3-4943e78286f6 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] 10.222.0.73 "GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed" status: 200 len: 1315 microversion: 2.1 time: 0.181346 Sep 16 09:53:50.341872 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 230/461] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:50 2022] GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:50.462449 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-c1607b19-f731-4a20-ad47-06da1b8987b2 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:50.462449 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-c1607b19-f731-4a20-ad47-06da1b8987b2 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: 60d9ad12-95e0-48c7-8db2-241f7c59cec6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:50.470632 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c1607b19-f731-4a20-ad47-06da1b8987b2 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:50.471856 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c1607b19-f731-4a20-ad47-06da1b8987b2 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:50.472293 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c1607b19-f731-4a20-ad47-06da1b8987b2 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:50.473170 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c1607b19-f731-4a20-ad47-06da1b8987b2 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:50.473741 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c1607b19-f731-4a20-ad47-06da1b8987b2 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:50.474231 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c1607b19-f731-4a20-ad47-06da1b8987b2 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:50.665659 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c1607b19-f731-4a20-ad47-06da1b8987b2 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:50.673504 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-c1607b19-f731-4a20-ad47-06da1b8987b2 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6" status: 200 len: 1314 microversion: 2.1 time: 0.220386 Sep 16 09:53:50.674107 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 232/462] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:50 2022] GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:51.040483 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-164fefe1-f302-4ee9-a0f0-599704df798e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:51.041013 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-164fefe1-f302-4ee9-a0f0-599704df798e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:51.047601 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-164fefe1-f302-4ee9-a0f0-599704df798e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:51.049922 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-164fefe1-f302-4ee9-a0f0-599704df798e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:51.049922 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-164fefe1-f302-4ee9-a0f0-599704df798e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:51.049922 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-164fefe1-f302-4ee9-a0f0-599704df798e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:51.049922 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-164fefe1-f302-4ee9-a0f0-599704df798e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:51.050302 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-164fefe1-f302-4ee9-a0f0-599704df798e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:51.209364 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-164fefe1-f302-4ee9-a0f0-599704df798e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:51.219782 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-164fefe1-f302-4ee9-a0f0-599704df798e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:51.222548 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-164fefe1-f302-4ee9-a0f0-599704df798e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:51.223885 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-164fefe1-f302-4ee9-a0f0-599704df798e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1804 microversion: 2.20 time: 0.187564 Sep 16 09:53:51.224590 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 231/463] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:53:51 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1804 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:53:51.365891 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-4a41728a-3272-42ec-a29b-7cbc1eda8afd tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:51.366601 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-4a41728a-3272-42ec-a29b-7cbc1eda8afd tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] [instance: 20bade93-24eb-4e9e-8851-b3ece7eb6fed] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:51.374857 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4a41728a-3272-42ec-a29b-7cbc1eda8afd tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:51.374857 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4a41728a-3272-42ec-a29b-7cbc1eda8afd tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:51.374857 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4a41728a-3272-42ec-a29b-7cbc1eda8afd tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:51.375365 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4a41728a-3272-42ec-a29b-7cbc1eda8afd tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:51.375519 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4a41728a-3272-42ec-a29b-7cbc1eda8afd tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:51.375949 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4a41728a-3272-42ec-a29b-7cbc1eda8afd tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:51.566087 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-4a41728a-3272-42ec-a29b-7cbc1eda8afd tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5c42006d0b442cb41952e5af6354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab67e77307d4b8f926244bc18308358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:51.574557 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-4a41728a-3272-42ec-a29b-7cbc1eda8afd tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] 10.222.0.73 "GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed" status: 200 len: 1315 microversion: 2.1 time: 0.213540 Sep 16 09:53:51.575338 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 233/464] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:51 2022] GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:51.696925 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-a1775668-295f-41b7-b7d7-fc4e0cb8f4e3 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:51.697460 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-a1775668-295f-41b7-b7d7-fc4e0cb8f4e3 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: 60d9ad12-95e0-48c7-8db2-241f7c59cec6] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:51.703759 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a1775668-295f-41b7-b7d7-fc4e0cb8f4e3 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:51.704308 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a1775668-295f-41b7-b7d7-fc4e0cb8f4e3 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:51.704803 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a1775668-295f-41b7-b7d7-fc4e0cb8f4e3 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:51.705553 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a1775668-295f-41b7-b7d7-fc4e0cb8f4e3 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:51.706022 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a1775668-295f-41b7-b7d7-fc4e0cb8f4e3 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:51.706445 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a1775668-295f-41b7-b7d7-fc4e0cb8f4e3 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:51.853909 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-a1775668-295f-41b7-b7d7-fc4e0cb8f4e3 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:51.864040 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-a1775668-295f-41b7-b7d7-fc4e0cb8f4e3 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6" status: 200 len: 1314 microversion: 2.1 time: 0.170795 Sep 16 09:53:51.865104 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 232/465] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:51 2022] GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:52.250439 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-7095347f-b7fd-411f-9133-adcd0f65e7d5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:52.251039 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-7095347f-b7fd-411f-9133-adcd0f65e7d5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:52.257773 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7095347f-b7fd-411f-9133-adcd0f65e7d5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:52.258256 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7095347f-b7fd-411f-9133-adcd0f65e7d5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:52.258688 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7095347f-b7fd-411f-9133-adcd0f65e7d5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:52.259378 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7095347f-b7fd-411f-9133-adcd0f65e7d5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:52.259829 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7095347f-b7fd-411f-9133-adcd0f65e7d5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:52.260260 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7095347f-b7fd-411f-9133-adcd0f65e7d5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:52.406776 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-7095347f-b7fd-411f-9133-adcd0f65e7d5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:52.418053 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-7095347f-b7fd-411f-9133-adcd0f65e7d5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:52.419465 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-7095347f-b7fd-411f-9133-adcd0f65e7d5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:52.420613 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-7095347f-b7fd-411f-9133-adcd0f65e7d5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1804 microversion: 2.20 time: 0.174162 Sep 16 09:53:52.421166 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 234/466] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:53:52 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1804 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:53:52.603167 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-bca79774-d32c-453f-9c52-e3ef71016d2d tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:52.603732 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-bca79774-d32c-453f-9c52-e3ef71016d2d tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] [instance: 20bade93-24eb-4e9e-8851-b3ece7eb6fed] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:52.610681 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-bca79774-d32c-453f-9c52-e3ef71016d2d tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:52.611166 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-bca79774-d32c-453f-9c52-e3ef71016d2d tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:52.611612 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-bca79774-d32c-453f-9c52-e3ef71016d2d tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:52.612938 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-bca79774-d32c-453f-9c52-e3ef71016d2d tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:52.613521 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-bca79774-d32c-453f-9c52-e3ef71016d2d tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:52.613943 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-bca79774-d32c-453f-9c52-e3ef71016d2d tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:52.749995 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-bca79774-d32c-453f-9c52-e3ef71016d2d tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5c42006d0b442cb41952e5af6354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab67e77307d4b8f926244bc18308358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:52.757976 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-bca79774-d32c-453f-9c52-e3ef71016d2d tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] 10.222.0.73 "GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed" status: 200 len: 1315 microversion: 2.1 time: 0.158810 Sep 16 09:53:52.760975 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 233/467] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:52 2022] GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:52.887038 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-fcf1b5e9-8ed0-4631-b95f-94853a729b3b tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:52.887869 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-fcf1b5e9-8ed0-4631-b95f-94853a729b3b tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: 60d9ad12-95e0-48c7-8db2-241f7c59cec6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:52.893929 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fcf1b5e9-8ed0-4631-b95f-94853a729b3b tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:52.894910 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fcf1b5e9-8ed0-4631-b95f-94853a729b3b tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:52.895344 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fcf1b5e9-8ed0-4631-b95f-94853a729b3b tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:52.896053 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fcf1b5e9-8ed0-4631-b95f-94853a729b3b tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:52.896503 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fcf1b5e9-8ed0-4631-b95f-94853a729b3b tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:52.896924 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fcf1b5e9-8ed0-4631-b95f-94853a729b3b tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:53.042379 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-fcf1b5e9-8ed0-4631-b95f-94853a729b3b tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:53.050595 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-fcf1b5e9-8ed0-4631-b95f-94853a729b3b tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6" status: 200 len: 1314 microversion: 2.1 time: 0.167418 Sep 16 09:53:53.051204 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 235/468] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:52 2022] GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:53.449724 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-d6d1a608-7a94-4210-adf7-bef610697f36 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:53.450346 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-d6d1a608-7a94-4210-adf7-bef610697f36 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:53.457008 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d6d1a608-7a94-4210-adf7-bef610697f36 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:53.458231 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d6d1a608-7a94-4210-adf7-bef610697f36 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:53.458689 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d6d1a608-7a94-4210-adf7-bef610697f36 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:53.459476 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d6d1a608-7a94-4210-adf7-bef610697f36 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:53.459964 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d6d1a608-7a94-4210-adf7-bef610697f36 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:53.460392 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d6d1a608-7a94-4210-adf7-bef610697f36 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:53.478754 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell1:SELECT=100 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:53:53.595869 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-d6d1a608-7a94-4210-adf7-bef610697f36 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:53.604616 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-d6d1a608-7a94-4210-adf7-bef610697f36 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:53.606084 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-d6d1a608-7a94-4210-adf7-bef610697f36 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:53.607251 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-d6d1a608-7a94-4210-adf7-bef610697f36 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1804 microversion: 2.20 time: 0.161697 Sep 16 09:53:53.607816 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 234/469] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:53:53 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1804 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:53:53.794732 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-a09d0b25-5f67-41a7-8cb4-fe43f1b47a1a tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:53.795372 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-a09d0b25-5f67-41a7-8cb4-fe43f1b47a1a tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] [instance: 20bade93-24eb-4e9e-8851-b3ece7eb6fed] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:53.803674 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a09d0b25-5f67-41a7-8cb4-fe43f1b47a1a tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:53.804178 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a09d0b25-5f67-41a7-8cb4-fe43f1b47a1a tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:53.804968 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a09d0b25-5f67-41a7-8cb4-fe43f1b47a1a tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:53.806124 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a09d0b25-5f67-41a7-8cb4-fe43f1b47a1a tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:53.806736 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a09d0b25-5f67-41a7-8cb4-fe43f1b47a1a tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:53.807347 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a09d0b25-5f67-41a7-8cb4-fe43f1b47a1a tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:53.997328 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-a09d0b25-5f67-41a7-8cb4-fe43f1b47a1a tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5c42006d0b442cb41952e5af6354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab67e77307d4b8f926244bc18308358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:54.005932 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-a09d0b25-5f67-41a7-8cb4-fe43f1b47a1a tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] 10.222.0.73 "GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed" status: 200 len: 1465 microversion: 2.1 time: 0.222758 Sep 16 09:53:54.021824 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 236/470] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:53 2022] GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed => generated 1465 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:54.057668 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-9683b145-8824-4525-a395-1902122a3f69 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:54.058267 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-9683b145-8824-4525-a395-1902122a3f69 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] [instance: 20bade93-24eb-4e9e-8851-b3ece7eb6fed] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:54.065047 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9683b145-8824-4525-a395-1902122a3f69 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:54.065626 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9683b145-8824-4525-a395-1902122a3f69 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:54.067826 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9683b145-8824-4525-a395-1902122a3f69 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:54.067826 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9683b145-8824-4525-a395-1902122a3f69 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:54.068071 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9683b145-8824-4525-a395-1902122a3f69 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:54.068688 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9683b145-8824-4525-a395-1902122a3f69 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:54.073279 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-c5c020bf-ee96-4ae4-bf59-5c1020f8196c tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:54.074368 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-c5c020bf-ee96-4ae4-bf59-5c1020f8196c tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: 60d9ad12-95e0-48c7-8db2-241f7c59cec6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:54.080645 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c5c020bf-ee96-4ae4-bf59-5c1020f8196c tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:54.081252 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c5c020bf-ee96-4ae4-bf59-5c1020f8196c tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:54.082002 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c5c020bf-ee96-4ae4-bf59-5c1020f8196c tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:54.082953 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c5c020bf-ee96-4ae4-bf59-5c1020f8196c tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:54.083624 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c5c020bf-ee96-4ae4-bf59-5c1020f8196c tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:54.084217 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c5c020bf-ee96-4ae4-bf59-5c1020f8196c tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:54.098477 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-9683b145-8824-4525-a395-1902122a3f69 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] [instance: 20bade93-24eb-4e9e-8851-b3ece7eb6fed] Going to try to terminate instance {{(pid=127671) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 09:53:54.227962 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c5c020bf-ee96-4ae4-bf59-5c1020f8196c tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:54.238976 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-c5c020bf-ee96-4ae4-bf59-5c1020f8196c tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6" status: 200 len: 1314 microversion: 2.1 time: 0.168927 Sep 16 09:53:54.239830 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 237/471] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:54 2022] GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:53:54.402862 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-9683b145-8824-4525-a395-1902122a3f69 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] 10.222.0.73 "DELETE /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed" status: 204 len: 0 microversion: 2.1 time: 0.349785 Sep 16 09:53:54.408222 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 235/472] 10.222.0.73 () {58 vars in 1239 bytes} [Fri Sep 16 09:53:54 2022] DELETE /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 09:53:54.412343 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-f9b42b1a-8e54-4b02-ac05-1657eafec7af tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:54.412987 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-f9b42b1a-8e54-4b02-ac05-1657eafec7af tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] [instance: 20bade93-24eb-4e9e-8851-b3ece7eb6fed] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:54.419006 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f9b42b1a-8e54-4b02-ac05-1657eafec7af tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:54.419497 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f9b42b1a-8e54-4b02-ac05-1657eafec7af tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:54.419934 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f9b42b1a-8e54-4b02-ac05-1657eafec7af tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:54.420631 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f9b42b1a-8e54-4b02-ac05-1657eafec7af tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:54.421092 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f9b42b1a-8e54-4b02-ac05-1657eafec7af tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:54.421522 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f9b42b1a-8e54-4b02-ac05-1657eafec7af tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:54.560310 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f9b42b1a-8e54-4b02-ac05-1657eafec7af tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5c42006d0b442cb41952e5af6354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab67e77307d4b8f926244bc18308358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:54.568115 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-f9b42b1a-8e54-4b02-ac05-1657eafec7af tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] 10.222.0.73 "GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed" status: 200 len: 1471 microversion: 2.1 time: 0.160291 Sep 16 09:53:54.568680 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 238/473] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:54 2022] GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed => generated 1471 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:54.633147 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-ad33246d-c1c5-4461-9cef-9e0b8deab1b1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:54.634589 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-ad33246d-c1c5-4461-9cef-9e0b8deab1b1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:54.639736 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ad33246d-c1c5-4461-9cef-9e0b8deab1b1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:54.640276 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ad33246d-c1c5-4461-9cef-9e0b8deab1b1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:54.640664 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ad33246d-c1c5-4461-9cef-9e0b8deab1b1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:54.641356 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ad33246d-c1c5-4461-9cef-9e0b8deab1b1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:54.641843 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ad33246d-c1c5-4461-9cef-9e0b8deab1b1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:54.642273 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ad33246d-c1c5-4461-9cef-9e0b8deab1b1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:54.823704 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-ad33246d-c1c5-4461-9cef-9e0b8deab1b1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:54.836731 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-ad33246d-c1c5-4461-9cef-9e0b8deab1b1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:54.838231 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-ad33246d-c1c5-4461-9cef-9e0b8deab1b1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:54.839418 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-ad33246d-c1c5-4461-9cef-9e0b8deab1b1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1804 microversion: 2.20 time: 0.210817 Sep 16 09:53:54.839997 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 236/474] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:53:54 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1804 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:53:55.262309 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d455e2ed-5cf5-4e1f-bf32-912bfab99c70 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:55.262953 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-d455e2ed-5cf5-4e1f-bf32-912bfab99c70 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: 60d9ad12-95e0-48c7-8db2-241f7c59cec6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:55.270527 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d455e2ed-5cf5-4e1f-bf32-912bfab99c70 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:55.271024 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d455e2ed-5cf5-4e1f-bf32-912bfab99c70 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:55.271461 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d455e2ed-5cf5-4e1f-bf32-912bfab99c70 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:55.272272 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d455e2ed-5cf5-4e1f-bf32-912bfab99c70 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:55.272816 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d455e2ed-5cf5-4e1f-bf32-912bfab99c70 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:55.273252 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d455e2ed-5cf5-4e1f-bf32-912bfab99c70 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:55.406122 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-d455e2ed-5cf5-4e1f-bf32-912bfab99c70 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:55.414139 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-d455e2ed-5cf5-4e1f-bf32-912bfab99c70 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6" status: 200 len: 1314 microversion: 2.1 time: 0.155824 Sep 16 09:53:55.414765 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 239/475] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:55 2022] GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:55.591223 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-644ea6d8-1aa4-4368-a83b-44696b274ce9 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:55.591867 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-644ea6d8-1aa4-4368-a83b-44696b274ce9 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] [instance: 20bade93-24eb-4e9e-8851-b3ece7eb6fed] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:55.603558 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-644ea6d8-1aa4-4368-a83b-44696b274ce9 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:55.603558 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-644ea6d8-1aa4-4368-a83b-44696b274ce9 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:55.603558 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-644ea6d8-1aa4-4368-a83b-44696b274ce9 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:55.603558 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-644ea6d8-1aa4-4368-a83b-44696b274ce9 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:55.604067 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-644ea6d8-1aa4-4368-a83b-44696b274ce9 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:55.604067 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-644ea6d8-1aa4-4368-a83b-44696b274ce9 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:55.740004 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-644ea6d8-1aa4-4368-a83b-44696b274ce9 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5c42006d0b442cb41952e5af6354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab67e77307d4b8f926244bc18308358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:55.748058 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-644ea6d8-1aa4-4368-a83b-44696b274ce9 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] 10.222.0.73 "GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed" status: 200 len: 1471 microversion: 2.1 time: 0.160849 Sep 16 09:53:55.748753 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 237/476] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:55 2022] GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed => generated 1471 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:55.866989 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-4c14a77d-bc8d-450e-81fd-956deb2c6611 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:55.867605 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-4c14a77d-bc8d-450e-81fd-956deb2c6611 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:55.873621 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4c14a77d-bc8d-450e-81fd-956deb2c6611 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:55.874109 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4c14a77d-bc8d-450e-81fd-956deb2c6611 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:55.874596 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4c14a77d-bc8d-450e-81fd-956deb2c6611 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:55.875314 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4c14a77d-bc8d-450e-81fd-956deb2c6611 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:55.875770 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4c14a77d-bc8d-450e-81fd-956deb2c6611 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:55.876195 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4c14a77d-bc8d-450e-81fd-956deb2c6611 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:56.011451 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-4c14a77d-bc8d-450e-81fd-956deb2c6611 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:56.020429 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-4c14a77d-bc8d-450e-81fd-956deb2c6611 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:56.021916 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-4c14a77d-bc8d-450e-81fd-956deb2c6611 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:56.023082 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-4c14a77d-bc8d-450e-81fd-956deb2c6611 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1804 microversion: 2.20 time: 0.160649 Sep 16 09:53:56.023638 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 240/477] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:53:55 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1804 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:53:56.436541 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-55c10b58-a9b0-474c-95b0-d310a3a625bc tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:56.437150 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-55c10b58-a9b0-474c-95b0-d310a3a625bc tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: 60d9ad12-95e0-48c7-8db2-241f7c59cec6] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:56.444196 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-55c10b58-a9b0-474c-95b0-d310a3a625bc tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:56.444581 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-55c10b58-a9b0-474c-95b0-d310a3a625bc tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:56.445076 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-55c10b58-a9b0-474c-95b0-d310a3a625bc tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:56.445777 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-55c10b58-a9b0-474c-95b0-d310a3a625bc tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:56.448200 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-55c10b58-a9b0-474c-95b0-d310a3a625bc tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:56.448200 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-55c10b58-a9b0-474c-95b0-d310a3a625bc tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:56.582481 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-55c10b58-a9b0-474c-95b0-d310a3a625bc tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:56.590597 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-55c10b58-a9b0-474c-95b0-d310a3a625bc tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6" status: 200 len: 1314 microversion: 2.1 time: 0.157988 Sep 16 09:53:56.591416 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 238/478] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:56 2022] GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:56.772649 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-4ff8f849-82a3-4497-ae63-b24dea0d6cdd tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:56.773242 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-4ff8f849-82a3-4497-ae63-b24dea0d6cdd tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] [instance: 20bade93-24eb-4e9e-8851-b3ece7eb6fed] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:56.779661 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4ff8f849-82a3-4497-ae63-b24dea0d6cdd tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:56.780142 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4ff8f849-82a3-4497-ae63-b24dea0d6cdd tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:56.780578 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4ff8f849-82a3-4497-ae63-b24dea0d6cdd tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:56.781265 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4ff8f849-82a3-4497-ae63-b24dea0d6cdd tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:56.781760 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4ff8f849-82a3-4497-ae63-b24dea0d6cdd tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:56.782193 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4ff8f849-82a3-4497-ae63-b24dea0d6cdd tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:56.923189 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-4ff8f849-82a3-4497-ae63-b24dea0d6cdd tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5c42006d0b442cb41952e5af6354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab67e77307d4b8f926244bc18308358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:56.931405 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-4ff8f849-82a3-4497-ae63-b24dea0d6cdd tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] 10.222.0.73 "GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed" status: 200 len: 1471 microversion: 2.1 time: 0.162779 Sep 16 09:53:56.931963 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 241/479] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:56 2022] GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed => generated 1471 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:53:57.056422 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-6e1331e1-ce6a-4be6-844f-4c8e6f1a478f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:57.057235 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-6e1331e1-ce6a-4be6-844f-4c8e6f1a478f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:57.063786 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6e1331e1-ce6a-4be6-844f-4c8e6f1a478f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:57.064254 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6e1331e1-ce6a-4be6-844f-4c8e6f1a478f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:57.064687 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6e1331e1-ce6a-4be6-844f-4c8e6f1a478f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:57.065379 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6e1331e1-ce6a-4be6-844f-4c8e6f1a478f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:57.065861 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6e1331e1-ce6a-4be6-844f-4c8e6f1a478f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:57.066338 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6e1331e1-ce6a-4be6-844f-4c8e6f1a478f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:57.294392 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-6e1331e1-ce6a-4be6-844f-4c8e6f1a478f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:57.305879 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-6e1331e1-ce6a-4be6-844f-4c8e6f1a478f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:57.307591 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-6e1331e1-ce6a-4be6-844f-4c8e6f1a478f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:57.308944 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-6e1331e1-ce6a-4be6-844f-4c8e6f1a478f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1804 microversion: 2.20 time: 0.256449 Sep 16 09:53:57.309536 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 239/480] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:53:57 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1804 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:53:57.614148 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-37e50595-62c3-4cd5-9ea5-0975f15a0ff7 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:57.614755 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-37e50595-62c3-4cd5-9ea5-0975f15a0ff7 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: 60d9ad12-95e0-48c7-8db2-241f7c59cec6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:57.620625 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-37e50595-62c3-4cd5-9ea5-0975f15a0ff7 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:57.621113 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-37e50595-62c3-4cd5-9ea5-0975f15a0ff7 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:57.621576 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-37e50595-62c3-4cd5-9ea5-0975f15a0ff7 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:57.622271 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-37e50595-62c3-4cd5-9ea5-0975f15a0ff7 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:57.622728 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-37e50595-62c3-4cd5-9ea5-0975f15a0ff7 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:57.623181 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-37e50595-62c3-4cd5-9ea5-0975f15a0ff7 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:57.798173 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-37e50595-62c3-4cd5-9ea5-0975f15a0ff7 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:57.807068 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [req-df7cf70e-8155-4ae9-8f4d-843d1c3b0aff req-5f2d2b0e-a56c-45d3-8c5e-0f17b5f2ebe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20bade93-24eb-4e9e-8851-b3ece7eb6fed", "name": "network-vif-deleted", "tag": "4302a618-12ca-4b92-bc76-2b29994a3581"}]} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:53:57.807857 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-37e50595-62c3-4cd5-9ea5-0975f15a0ff7 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6" status: 200 len: 1498 microversion: 2.1 time: 0.198061 Sep 16 09:53:57.809610 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 242/481] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:57 2022] GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6 => generated 1498 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:57.828041 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-df7cf70e-8155-4ae9-8f4d-843d1c3b0aff req-5f2d2b0e-a56c-45d3-8c5e-0f17b5f2ebe8 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:57.828597 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-df7cf70e-8155-4ae9-8f4d-843d1c3b0aff req-5f2d2b0e-a56c-45d3-8c5e-0f17b5f2ebe8 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:57.829734 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-df7cf70e-8155-4ae9-8f4d-843d1c3b0aff req-5f2d2b0e-a56c-45d3-8c5e-0f17b5f2ebe8 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:57.846470 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.compute.server_external_events [req-df7cf70e-8155-4ae9-8f4d-843d1c3b0aff req-5f2d2b0e-a56c-45d3-8c5e-0f17b5f2ebe8 service nova] Creating event network-vif-deleted:4302a618-12ca-4b92-bc76-2b29994a3581 for instance 20bade93-24eb-4e9e-8851-b3ece7eb6fed on hv-cinder-79053 Sep 16 09:53:57.851692 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [req-df7cf70e-8155-4ae9-8f4d-843d1c3b0aff req-5f2d2b0e-a56c-45d3-8c5e-0f17b5f2ebe8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052640 Sep 16 09:53:57.856983 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 240/482] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:53:57.954540 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-dc8e73f9-95f5-4bf2-a6ca-9e5a4fe98c9c tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:57.955154 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-dc8e73f9-95f5-4bf2-a6ca-9e5a4fe98c9c tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] [instance: 20bade93-24eb-4e9e-8851-b3ece7eb6fed] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:57.961481 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dc8e73f9-95f5-4bf2-a6ca-9e5a4fe98c9c tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:57.962009 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dc8e73f9-95f5-4bf2-a6ca-9e5a4fe98c9c tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:57.962463 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dc8e73f9-95f5-4bf2-a6ca-9e5a4fe98c9c tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:57.963153 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dc8e73f9-95f5-4bf2-a6ca-9e5a4fe98c9c tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:57.963648 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dc8e73f9-95f5-4bf2-a6ca-9e5a4fe98c9c tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:57.964039 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dc8e73f9-95f5-4bf2-a6ca-9e5a4fe98c9c tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:57.979715 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=100 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:53:58.028678 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-dc8e73f9-95f5-4bf2-a6ca-9e5a4fe98c9c tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5c42006d0b442cb41952e5af6354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab67e77307d4b8f926244bc18308358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:58.037488 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-dc8e73f9-95f5-4bf2-a6ca-9e5a4fe98c9c tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] 10.222.0.73 "GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed" status: 200 len: 1429 microversion: 2.1 time: 0.086822 Sep 16 09:53:58.038091 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 243/483] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:57 2022] GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed => generated 1429 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:53:58.340199 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-93e00d70-80bb-4ab1-b4c0-88d999375087 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:58.340908 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-93e00d70-80bb-4ab1-b4c0-88d999375087 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:58.356733 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-93e00d70-80bb-4ab1-b4c0-88d999375087 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:58.357238 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-93e00d70-80bb-4ab1-b4c0-88d999375087 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:58.357722 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-93e00d70-80bb-4ab1-b4c0-88d999375087 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:58.358848 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-93e00d70-80bb-4ab1-b4c0-88d999375087 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:58.358966 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-93e00d70-80bb-4ab1-b4c0-88d999375087 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:58.359326 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-93e00d70-80bb-4ab1-b4c0-88d999375087 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:58.517325 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-93e00d70-80bb-4ab1-b4c0-88d999375087 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:58.524287 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-93e00d70-80bb-4ab1-b4c0-88d999375087 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:58.526172 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-93e00d70-80bb-4ab1-b4c0-88d999375087 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:58.527348 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-93e00d70-80bb-4ab1-b4c0-88d999375087 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1804 microversion: 2.20 time: 0.196250 Sep 16 09:53:58.527919 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 241/484] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:53:58 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1804 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:53:58.760223 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-70c585bb-533b-42f0-bb28-6b3bea44f5a2 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:58.760731 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-70c585bb-533b-42f0-bb28-6b3bea44f5a2 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: 60d9ad12-95e0-48c7-8db2-241f7c59cec6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:58.767219 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-70c585bb-533b-42f0-bb28-6b3bea44f5a2 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:58.767722 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-70c585bb-533b-42f0-bb28-6b3bea44f5a2 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:58.768158 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-70c585bb-533b-42f0-bb28-6b3bea44f5a2 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:58.771331 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-70c585bb-533b-42f0-bb28-6b3bea44f5a2 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:58.771331 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-70c585bb-533b-42f0-bb28-6b3bea44f5a2 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:58.771331 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-70c585bb-533b-42f0-bb28-6b3bea44f5a2 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:58.799283 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-70c585bb-533b-42f0-bb28-6b3bea44f5a2 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: 60d9ad12-95e0-48c7-8db2-241f7c59cec6] Going to try to terminate instance {{(pid=127670) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 09:53:59.061515 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-396c5894-4c30-4d0a-be2e-6dc9b39a80a8 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:59.062228 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-396c5894-4c30-4d0a-be2e-6dc9b39a80a8 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] [instance: 20bade93-24eb-4e9e-8851-b3ece7eb6fed] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:59.069193 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-396c5894-4c30-4d0a-be2e-6dc9b39a80a8 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:59.069766 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-396c5894-4c30-4d0a-be2e-6dc9b39a80a8 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:59.070217 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-396c5894-4c30-4d0a-be2e-6dc9b39a80a8 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:59.070922 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-396c5894-4c30-4d0a-be2e-6dc9b39a80a8 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:59.071387 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-396c5894-4c30-4d0a-be2e-6dc9b39a80a8 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:59.071822 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-396c5894-4c30-4d0a-be2e-6dc9b39a80a8 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:59.088259 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-70c585bb-533b-42f0-bb28-6b3bea44f5a2 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "DELETE /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6" status: 204 len: 0 microversion: 2.1 time: 0.331708 Sep 16 09:53:59.089358 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 244/485] 10.222.0.73 () {58 vars in 1239 bytes} [Fri Sep 16 09:53:58 2022] DELETE /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 09:53:59.098318 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-94aaeb16-8be2-42f8-ae2b-e7c7b1adeb9d tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:59.099047 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-94aaeb16-8be2-42f8-ae2b-e7c7b1adeb9d tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: 60d9ad12-95e0-48c7-8db2-241f7c59cec6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:59.105112 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-94aaeb16-8be2-42f8-ae2b-e7c7b1adeb9d tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:59.105650 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-94aaeb16-8be2-42f8-ae2b-e7c7b1adeb9d tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:59.106088 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-94aaeb16-8be2-42f8-ae2b-e7c7b1adeb9d tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:59.106782 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-94aaeb16-8be2-42f8-ae2b-e7c7b1adeb9d tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:59.107232 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-94aaeb16-8be2-42f8-ae2b-e7c7b1adeb9d tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:59.107343 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-396c5894-4c30-4d0a-be2e-6dc9b39a80a8 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:59.107653 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-94aaeb16-8be2-42f8-ae2b-e7c7b1adeb9d tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:59.107794 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-396c5894-4c30-4d0a-be2e-6dc9b39a80a8 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:59.108241 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-396c5894-4c30-4d0a-be2e-6dc9b39a80a8 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:59.108786 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.objects.instance [None req-396c5894-4c30-4d0a-be2e-6dc9b39a80a8 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lazy-loading 'fault' on Instance uuid 20bade93-24eb-4e9e-8851-b3ece7eb6fed {{(pid=127671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 09:53:59.153020 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-396c5894-4c30-4d0a-be2e-6dc9b39a80a8 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5c42006d0b442cb41952e5af6354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab67e77307d4b8f926244bc18308358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:59.163599 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-396c5894-4c30-4d0a-be2e-6dc9b39a80a8 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] 10.222.0.73 "GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed" status: 200 len: 1305 microversion: 2.1 time: 0.106150 Sep 16 09:53:59.164224 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 242/486] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:59 2022] GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed => generated 1305 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:53:59.246909 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-94aaeb16-8be2-42f8-ae2b-e7c7b1adeb9d tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:59.254678 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-94aaeb16-8be2-42f8-ae2b-e7c7b1adeb9d tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6" status: 200 len: 1504 microversion: 2.1 time: 0.161161 Sep 16 09:53:59.255241 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 245/487] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:53:59 2022] GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6 => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:53:59.554818 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-55016d71-ff76-48f8-a9f7-1aa2a6e6742d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:53:59.555405 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-55016d71-ff76-48f8-a9f7-1aa2a6e6742d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:53:59.558032 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:53:59.564119 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-55016d71-ff76-48f8-a9f7-1aa2a6e6742d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:59.564604 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-55016d71-ff76-48f8-a9f7-1aa2a6e6742d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:59.565043 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-55016d71-ff76-48f8-a9f7-1aa2a6e6742d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:59.565768 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-55016d71-ff76-48f8-a9f7-1aa2a6e6742d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:53:59.566252 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-55016d71-ff76-48f8-a9f7-1aa2a6e6742d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:53:59.566670 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-55016d71-ff76-48f8-a9f7-1aa2a6e6742d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:53:59.708126 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-55016d71-ff76-48f8-a9f7-1aa2a6e6742d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:59.717372 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-55016d71-ff76-48f8-a9f7-1aa2a6e6742d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:59.718931 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-55016d71-ff76-48f8-a9f7-1aa2a6e6742d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:53:59.720240 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-55016d71-ff76-48f8-a9f7-1aa2a6e6742d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1804 microversion: 2.20 time: 0.170774 Sep 16 09:53:59.720821 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 243/488] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:53:59 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1804 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:54:00.193805 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-26f885c9-be3b-4c84-b315-57205401565a tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:00.194610 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-26f885c9-be3b-4c84-b315-57205401565a tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] [instance: 20bade93-24eb-4e9e-8851-b3ece7eb6fed] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:00.201086 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-26f885c9-be3b-4c84-b315-57205401565a tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:00.201609 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-26f885c9-be3b-4c84-b315-57205401565a tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:00.202059 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-26f885c9-be3b-4c84-b315-57205401565a tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:00.202797 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-26f885c9-be3b-4c84-b315-57205401565a tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:00.203259 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-26f885c9-be3b-4c84-b315-57205401565a tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:00.203690 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-26f885c9-be3b-4c84-b315-57205401565a tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:00.236677 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-26f885c9-be3b-4c84-b315-57205401565a tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:00.237162 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-26f885c9-be3b-4c84-b315-57205401565a tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:00.238177 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-26f885c9-be3b-4c84-b315-57205401565a tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:00.238631 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.objects.instance [None req-26f885c9-be3b-4c84-b315-57205401565a tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lazy-loading 'fault' on Instance uuid 20bade93-24eb-4e9e-8851-b3ece7eb6fed {{(pid=127670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 09:54:00.276919 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-fca29160-9e91-4a51-8f12-5af8169ab940 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:00.278002 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-fca29160-9e91-4a51-8f12-5af8169ab940 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: 60d9ad12-95e0-48c7-8db2-241f7c59cec6] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:00.280372 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-26f885c9-be3b-4c84-b315-57205401565a tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5c42006d0b442cb41952e5af6354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab67e77307d4b8f926244bc18308358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:00.283821 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-fca29160-9e91-4a51-8f12-5af8169ab940 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:00.284325 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-fca29160-9e91-4a51-8f12-5af8169ab940 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:00.284764 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-fca29160-9e91-4a51-8f12-5af8169ab940 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:00.285470 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-fca29160-9e91-4a51-8f12-5af8169ab940 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:00.286129 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-fca29160-9e91-4a51-8f12-5af8169ab940 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:00.286563 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-fca29160-9e91-4a51-8f12-5af8169ab940 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:00.288383 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-26f885c9-be3b-4c84-b315-57205401565a tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] 10.222.0.73 "GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed" status: 200 len: 1305 microversion: 2.1 time: 0.099806 Sep 16 09:54:00.289000 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 246/489] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:00 2022] GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed => generated 1305 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:54:00.421838 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-fca29160-9e91-4a51-8f12-5af8169ab940 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:00.429715 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-fca29160-9e91-4a51-8f12-5af8169ab940 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6" status: 200 len: 1504 microversion: 2.1 time: 0.156690 Sep 16 09:54:00.430283 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 244/490] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:00 2022] GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:54:00.748274 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-a95658ff-d001-4559-970f-147e0255db76 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:00.748948 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-a95658ff-d001-4559-970f-147e0255db76 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:00.755622 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a95658ff-d001-4559-970f-147e0255db76 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:00.756115 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a95658ff-d001-4559-970f-147e0255db76 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:00.756553 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a95658ff-d001-4559-970f-147e0255db76 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:00.757258 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a95658ff-d001-4559-970f-147e0255db76 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:00.757759 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a95658ff-d001-4559-970f-147e0255db76 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:00.765485 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a95658ff-d001-4559-970f-147e0255db76 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:00.900310 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-a95658ff-d001-4559-970f-147e0255db76 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:00.909979 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-a95658ff-d001-4559-970f-147e0255db76 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:00.911372 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-a95658ff-d001-4559-970f-147e0255db76 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:00.912540 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-a95658ff-d001-4559-970f-147e0255db76 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1804 microversion: 2.20 time: 0.168321 Sep 16 09:54:00.913096 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 247/491] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:54:00 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1804 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:54:01.311730 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-6cd81222-c4b8-46c7-bb2c-01ddff564a1b tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:01.312349 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-6cd81222-c4b8-46c7-bb2c-01ddff564a1b tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] [instance: 20bade93-24eb-4e9e-8851-b3ece7eb6fed] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:01.318736 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6cd81222-c4b8-46c7-bb2c-01ddff564a1b tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:01.320252 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6cd81222-c4b8-46c7-bb2c-01ddff564a1b tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:01.320252 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6cd81222-c4b8-46c7-bb2c-01ddff564a1b tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:01.320597 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6cd81222-c4b8-46c7-bb2c-01ddff564a1b tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:01.320753 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6cd81222-c4b8-46c7-bb2c-01ddff564a1b tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:01.321179 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6cd81222-c4b8-46c7-bb2c-01ddff564a1b tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:01.351589 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6cd81222-c4b8-46c7-bb2c-01ddff564a1b tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:01.352091 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6cd81222-c4b8-46c7-bb2c-01ddff564a1b tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:01.352507 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6cd81222-c4b8-46c7-bb2c-01ddff564a1b tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:01.352948 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.objects.instance [None req-6cd81222-c4b8-46c7-bb2c-01ddff564a1b tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lazy-loading 'fault' on Instance uuid 20bade93-24eb-4e9e-8851-b3ece7eb6fed {{(pid=127671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 09:54:01.411129 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-6cd81222-c4b8-46c7-bb2c-01ddff564a1b tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5c42006d0b442cb41952e5af6354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab67e77307d4b8f926244bc18308358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:01.420439 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-6cd81222-c4b8-46c7-bb2c-01ddff564a1b tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] 10.222.0.73 "GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed" status: 200 len: 1305 microversion: 2.1 time: 0.112562 Sep 16 09:54:01.423697 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 245/492] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:01 2022] GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed => generated 1305 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:54:01.455347 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-96f3b694-7e9b-4c7d-8dc6-5c8ac6223cc7 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:01.458056 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-96f3b694-7e9b-4c7d-8dc6-5c8ac6223cc7 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: 60d9ad12-95e0-48c7-8db2-241f7c59cec6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:01.466127 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-96f3b694-7e9b-4c7d-8dc6-5c8ac6223cc7 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:01.466978 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-96f3b694-7e9b-4c7d-8dc6-5c8ac6223cc7 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:01.467752 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-96f3b694-7e9b-4c7d-8dc6-5c8ac6223cc7 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:01.468972 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-96f3b694-7e9b-4c7d-8dc6-5c8ac6223cc7 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:01.469535 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-96f3b694-7e9b-4c7d-8dc6-5c8ac6223cc7 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:01.470103 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-96f3b694-7e9b-4c7d-8dc6-5c8ac6223cc7 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:01.604326 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-96f3b694-7e9b-4c7d-8dc6-5c8ac6223cc7 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:01.612418 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-96f3b694-7e9b-4c7d-8dc6-5c8ac6223cc7 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6" status: 200 len: 1504 microversion: 2.1 time: 0.162972 Sep 16 09:54:01.613741 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 248/493] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:01 2022] GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6 => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:54:01.938650 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-2a55132d-8fc2-4301-bea2-6fa9762b6081 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:01.939409 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-2a55132d-8fc2-4301-bea2-6fa9762b6081 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:01.945751 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2a55132d-8fc2-4301-bea2-6fa9762b6081 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:01.946232 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2a55132d-8fc2-4301-bea2-6fa9762b6081 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:01.946665 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2a55132d-8fc2-4301-bea2-6fa9762b6081 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:01.947357 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2a55132d-8fc2-4301-bea2-6fa9762b6081 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:01.947807 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2a55132d-8fc2-4301-bea2-6fa9762b6081 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:01.948229 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2a55132d-8fc2-4301-bea2-6fa9762b6081 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:02.085814 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-2a55132d-8fc2-4301-bea2-6fa9762b6081 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:02.094589 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-2a55132d-8fc2-4301-bea2-6fa9762b6081 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:02.096048 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-2a55132d-8fc2-4301-bea2-6fa9762b6081 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:02.097272 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-2a55132d-8fc2-4301-bea2-6fa9762b6081 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1804 microversion: 2.20 time: 0.162543 Sep 16 09:54:02.097881 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 246/494] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:54:01 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1804 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 09:54:02.189119 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-58beb7b1-fdf3-47db-8c14-ea29cdc55c75 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:02.189565 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-58beb7b1-fdf3-47db-8c14-ea29cdc55c75 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 33e0e447-38a7-474d-ae32-1941ee3260c6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:02.196413 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-58beb7b1-fdf3-47db-8c14-ea29cdc55c75 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:02.196909 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-58beb7b1-fdf3-47db-8c14-ea29cdc55c75 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:02.197348 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-58beb7b1-fdf3-47db-8c14-ea29cdc55c75 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:02.198088 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-58beb7b1-fdf3-47db-8c14-ea29cdc55c75 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:02.198549 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-58beb7b1-fdf3-47db-8c14-ea29cdc55c75 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:02.198979 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-58beb7b1-fdf3-47db-8c14-ea29cdc55c75 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:02.224085 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-58beb7b1-fdf3-47db-8c14-ea29cdc55c75 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6/ips" status: 200 len: 150 microversion: 2.1 time: 0.038816 Sep 16 09:54:02.226216 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 249/495] 10.222.0.73 () {58 vars in 1248 bytes} [Fri Sep 16 09:54:02 2022] GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:54:02.237256 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-752466b1-ff54-41fe-afa6-e34218d4550c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "671204a1-d033-4b52-a5b8-5fe366c8f42b"}} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:54:02.239789 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-752466b1-ff54-41fe-afa6-e34218d4550c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 33e0e447-38a7-474d-ae32-1941ee3260c6] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:02.245769 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-752466b1-ff54-41fe-afa6-e34218d4550c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:02.246264 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-752466b1-ff54-41fe-afa6-e34218d4550c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:02.246710 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-752466b1-ff54-41fe-afa6-e34218d4550c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:02.247427 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-752466b1-ff54-41fe-afa6-e34218d4550c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:02.247891 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-752466b1-ff54-41fe-afa6-e34218d4550c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:02.248326 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-752466b1-ff54-41fe-afa6-e34218d4550c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:02.339695 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.wsgi [None req-752466b1-ff54-41fe-afa6-e34218d4550c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] HTTP exception thrown: Invalid volume: volume 671204a1-d033-4b52-a5b8-5fe366c8f42b is already attached to instances: efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 Sep 16 09:54:02.341568 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-752466b1-ff54-41fe-afa6-e34218d4550c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Request method failure captured: Sep 16 09:54:02.341568 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: request: POST /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6/os-volume_attachments HTTP/1.1 Sep 16 09:54:02.341568 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept: application/json Sep 16 09:54:02.341568 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept-Encoding: identity Sep 16 09:54:02.341568 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Connection: close Sep 16 09:54:02.341568 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Length: 74 Sep 16 09:54:02.341568 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Type: application/json Sep 16 09:54:02.341568 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Host: 10.222.0.73 Sep 16 09:54:02.341568 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Openstack-System-Scope: None Sep 16 09:54:02.341568 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: User-Agent: python-urllib3/1.26.12 Sep 16 09:54:02.341568 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Auth-Token: gAAAAABjJEbyIogtO-fgeLO9uv3_XXDwxtVD1eIMLN7x0Q3ZD4pj8hYAM6nbLEwKtYbBaube26iELy7B5lx0xTiRTzRgXZs50v25I7qfb15XuH_i9MG8_BlVJAG6OZoKZu6GI9c8evKltkWyTv3vVrhFavNaXN0ju9i-ZnFY6eOsWcD7CFugHvs Sep 16 09:54:02.341568 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Id: None Sep 16 09:54:02.341568 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Name: None Sep 16 09:54:02.341568 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Identity-Status: Confirmed Sep 16 09:54:02.341568 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Is-Admin-Project: True Sep 16 09:54:02.341568 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Id: default Sep 16 09:54:02.341568 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Name: Default Sep 16 09:54:02.341568 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Id: 75007587f92646f686881c2e1bfb7b2d Sep 16 09:54:02.341568 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Name: tempest-AttachVolumeNegativeTest-1478592665 Sep 16 09:54:02.341568 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Role: reader,member Sep 16 09:54:02.341568 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Roles: reader,member Sep 16 09:54:02.343191 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/75007587f92646f686881c2e1bfb7b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_75007587f92646f686881c2e1bfb7b2d", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/75007587f92646f686881c2e1bfb7b2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/75007587f92646f686881c2e1bfb7b2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 09:54:02.343191 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant: tempest-AttachVolumeNegativeTest-1478592665 Sep 16 09:54:02.343191 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Id: 75007587f92646f686881c2e1bfb7b2d Sep 16 09:54:02.343191 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1478592665 Sep 16 09:54:02.343191 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User: tempest-AttachVolumeNegativeTest-1478592665-project Sep 16 09:54:02.343191 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Id: default Sep 16 09:54:02.343191 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Name: Default Sep 16 09:54:02.343191 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Id: 7dca5726e89343828e25def6e6c274bb Sep 16 09:54:02.343191 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Name: tempest-AttachVolumeNegativeTest-1478592665-project Sep 16 09:54:02.343191 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Sep 16 09:54:02.343191 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: {"volumeAttachment": {"volumeId": "671204a1-d033-4b52-a5b8-5fe366c8f42b"}} Sep 16 09:54:02.343191 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: method: > Sep 16 09:54:02.344061 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: exception: Invalid volume: volume 671204a1-d033-4b52-a5b8-5fe366c8f42b is already attached to instances: efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 Sep 16 09:54:02.344061 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: action_args: {'server_id': '33e0e447-38a7-474d-ae32-1941ee3260c6', 'body': {'volumeAttachment': {'volumeId': '671204a1-d033-4b52-a5b8-5fe366c8f42b'}}} Sep 16 09:54:02.344061 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 09:54:02.344061 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:54:02.344061 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 16 09:54:02.344061 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 16 09:54:02.344061 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 16 09:54:02.344061 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 16 09:54:02.344061 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 16 09:54:02.344061 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 16 09:54:02.344061 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 16 09:54:02.344061 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 16 09:54:02.344061 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 16 09:54:02.344061 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 16 09:54:02.344061 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 671204a1-d033-4b52-a5b8-5fe366c8f42b is already attached to instances: efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 Sep 16 09:54:02.344061 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:54:02.344061 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:54:02.344061 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:54:02.344061 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:54:02.345413 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:54:02.345413 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:54:02.345413 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 09:54:02.345413 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 09:54:02.345413 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 09:54:02.345413 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:54:02.345413 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 09:54:02.345413 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 09:54:02.345413 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 09:54:02.345413 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 09:54:02.345413 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 09:54:02.345413 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 09:54:02.345413 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 16 09:54:02.345413 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 16 09:54:02.345413 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 671204a1-d033-4b52-a5b8-5fe366c8f42b is already attached to instances: efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 Sep 16 09:54:02.345413 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:54:02.345413 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:54:02.345413 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:54:02.345413 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:54:02.345413 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:54:02.346766 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:54:02.346766 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 09:54:02.346766 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 09:54:02.346766 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 671204a1-d033-4b52-a5b8-5fe366c8f42b is already attached to instances: efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 Sep 16 09:54:02.346766 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:54:02.346766 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-752466b1-ff54-41fe-afa6-e34218d4550c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Returning 400 to user: Invalid volume: volume 671204a1-d033-4b52-a5b8-5fe366c8f42b is already attached to instances: efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 {{(pid=127671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 09:54:02.346766 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-752466b1-ff54-41fe-afa6-e34218d4550c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "POST /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.111501 Sep 16 09:54:02.346766 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 247/496] 10.222.0.73 () {60 vars in 1323 bytes} [Fri Sep 16 09:54:02 2022] POST /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6/os-volume_attachments => generated 174 bytes in 114 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 09:54:02.355340 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-0b870461-2bc6-4be3-ad08-cf683e0514ad tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:02.355877 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-0b870461-2bc6-4be3-ad08-cf683e0514ad tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 33e0e447-38a7-474d-ae32-1941ee3260c6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:02.362145 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0b870461-2bc6-4be3-ad08-cf683e0514ad tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:02.362677 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0b870461-2bc6-4be3-ad08-cf683e0514ad tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:02.363108 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0b870461-2bc6-4be3-ad08-cf683e0514ad tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:02.363802 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0b870461-2bc6-4be3-ad08-cf683e0514ad tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:02.364252 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0b870461-2bc6-4be3-ad08-cf683e0514ad tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:02.364671 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0b870461-2bc6-4be3-ad08-cf683e0514ad tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:02.392685 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-0b870461-2bc6-4be3-ad08-cf683e0514ad tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 33e0e447-38a7-474d-ae32-1941ee3260c6] Going to try to terminate instance {{(pid=127670) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 09:54:02.444681 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-c60cb0dd-0133-46b8-9c06-83464ff01b6f tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:02.445195 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-c60cb0dd-0133-46b8-9c06-83464ff01b6f tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] [instance: 20bade93-24eb-4e9e-8851-b3ece7eb6fed] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:02.452721 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c60cb0dd-0133-46b8-9c06-83464ff01b6f tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:02.453316 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c60cb0dd-0133-46b8-9c06-83464ff01b6f tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:02.453659 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c60cb0dd-0133-46b8-9c06-83464ff01b6f tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:02.454381 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c60cb0dd-0133-46b8-9c06-83464ff01b6f tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:02.454825 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c60cb0dd-0133-46b8-9c06-83464ff01b6f tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:02.455269 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c60cb0dd-0133-46b8-9c06-83464ff01b6f tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:02.490147 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c60cb0dd-0133-46b8-9c06-83464ff01b6f tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:02.491166 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c60cb0dd-0133-46b8-9c06-83464ff01b6f tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:02.491799 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c60cb0dd-0133-46b8-9c06-83464ff01b6f tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:02.492436 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.objects.instance [None req-c60cb0dd-0133-46b8-9c06-83464ff01b6f tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lazy-loading 'fault' on Instance uuid 20bade93-24eb-4e9e-8851-b3ece7eb6fed {{(pid=127671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 09:54:02.539013 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-c60cb0dd-0133-46b8-9c06-83464ff01b6f tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5c42006d0b442cb41952e5af6354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab67e77307d4b8f926244bc18308358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:02.546863 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-c60cb0dd-0133-46b8-9c06-83464ff01b6f tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] 10.222.0.73 "GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed" status: 200 len: 1305 microversion: 2.1 time: 0.107105 Sep 16 09:54:02.547441 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 248/497] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:02 2022] GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed => generated 1305 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:54:02.636040 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-5531d2fa-d674-4c8c-8d86-1c23a23ecc2a tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:02.636683 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-5531d2fa-d674-4c8c-8d86-1c23a23ecc2a tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: 60d9ad12-95e0-48c7-8db2-241f7c59cec6] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:02.642723 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5531d2fa-d674-4c8c-8d86-1c23a23ecc2a tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:02.643215 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5531d2fa-d674-4c8c-8d86-1c23a23ecc2a tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:02.643663 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5531d2fa-d674-4c8c-8d86-1c23a23ecc2a tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:02.644428 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5531d2fa-d674-4c8c-8d86-1c23a23ecc2a tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:02.644893 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5531d2fa-d674-4c8c-8d86-1c23a23ecc2a tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:02.645329 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5531d2fa-d674-4c8c-8d86-1c23a23ecc2a tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:02.649258 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:54:02.678222 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-0b870461-2bc6-4be3-ad08-cf683e0514ad tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "DELETE /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6" status: 204 len: 0 microversion: 2.1 time: 0.326521 Sep 16 09:54:02.678979 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 250/498] 10.222.0.73 () {58 vars in 1239 bytes} [Fri Sep 16 09:54:02 2022] DELETE /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 16 09:54:02.688151 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-1dc68f49-30f5-4f6e-8658-5b2d1edfc41f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:02.689178 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-1dc68f49-30f5-4f6e-8658-5b2d1edfc41f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 33e0e447-38a7-474d-ae32-1941ee3260c6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:02.696836 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1dc68f49-30f5-4f6e-8658-5b2d1edfc41f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:02.697379 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1dc68f49-30f5-4f6e-8658-5b2d1edfc41f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:02.698105 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1dc68f49-30f5-4f6e-8658-5b2d1edfc41f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:02.698944 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1dc68f49-30f5-4f6e-8658-5b2d1edfc41f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:02.699466 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1dc68f49-30f5-4f6e-8658-5b2d1edfc41f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:02.699997 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1dc68f49-30f5-4f6e-8658-5b2d1edfc41f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:02.782015 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-5531d2fa-d674-4c8c-8d86-1c23a23ecc2a tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:02.791016 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-5531d2fa-d674-4c8c-8d86-1c23a23ecc2a tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6" status: 200 len: 1504 microversion: 2.1 time: 0.158749 Sep 16 09:54:02.791591 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 249/499] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:02 2022] GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6 => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:54:02.840810 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-1dc68f49-30f5-4f6e-8658-5b2d1edfc41f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:02.849077 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-1dc68f49-30f5-4f6e-8658-5b2d1edfc41f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6" status: 200 len: 1682 microversion: 2.1 time: 0.165637 Sep 16 09:54:02.851010 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 251/500] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:02 2022] GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6 => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:54:03.123467 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-1e768f8c-2291-403c-9ad1-0ff71de36684 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:03.124085 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-1e768f8c-2291-403c-9ad1-0ff71de36684 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:03.131094 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1e768f8c-2291-403c-9ad1-0ff71de36684 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:03.131584 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1e768f8c-2291-403c-9ad1-0ff71de36684 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:03.132027 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1e768f8c-2291-403c-9ad1-0ff71de36684 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:03.132729 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1e768f8c-2291-403c-9ad1-0ff71de36684 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:03.133188 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1e768f8c-2291-403c-9ad1-0ff71de36684 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:03.133655 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1e768f8c-2291-403c-9ad1-0ff71de36684 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:03.318287 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-1e768f8c-2291-403c-9ad1-0ff71de36684 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:03.327310 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-1e768f8c-2291-403c-9ad1-0ff71de36684 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:03.328773 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-1e768f8c-2291-403c-9ad1-0ff71de36684 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:03.329986 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-1e768f8c-2291-403c-9ad1-0ff71de36684 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1804 microversion: 2.20 time: 0.210422 Sep 16 09:54:03.330583 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 250/501] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:54:03 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1804 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:54:03.573008 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-401500e5-e312-4e94-9c94-bcd7e38e225f tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:03.573593 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-401500e5-e312-4e94-9c94-bcd7e38e225f tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] [instance: 20bade93-24eb-4e9e-8851-b3ece7eb6fed] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:03.580155 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-401500e5-e312-4e94-9c94-bcd7e38e225f tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:03.580652 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-401500e5-e312-4e94-9c94-bcd7e38e225f tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:03.581098 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-401500e5-e312-4e94-9c94-bcd7e38e225f tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:03.583168 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-401500e5-e312-4e94-9c94-bcd7e38e225f tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:03.583645 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-401500e5-e312-4e94-9c94-bcd7e38e225f tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:03.584086 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-401500e5-e312-4e94-9c94-bcd7e38e225f tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:03.616325 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-401500e5-e312-4e94-9c94-bcd7e38e225f tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:03.616874 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-401500e5-e312-4e94-9c94-bcd7e38e225f tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:03.617284 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-401500e5-e312-4e94-9c94-bcd7e38e225f tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:03.617943 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.objects.instance [None req-401500e5-e312-4e94-9c94-bcd7e38e225f tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lazy-loading 'fault' on Instance uuid 20bade93-24eb-4e9e-8851-b3ece7eb6fed {{(pid=127670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 09:54:03.668158 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-401500e5-e312-4e94-9c94-bcd7e38e225f tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5c42006d0b442cb41952e5af6354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab67e77307d4b8f926244bc18308358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:03.676830 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-401500e5-e312-4e94-9c94-bcd7e38e225f tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] 10.222.0.73 "GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed" status: 200 len: 1305 microversion: 2.1 time: 0.108215 Sep 16 09:54:03.677410 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 252/502] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:03 2022] GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed => generated 1305 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:54:03.815491 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-862aa39d-a806-43c1-a937-a587d7a8a64a tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:03.816775 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-862aa39d-a806-43c1-a937-a587d7a8a64a tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: 60d9ad12-95e0-48c7-8db2-241f7c59cec6] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:03.827792 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-862aa39d-a806-43c1-a937-a587d7a8a64a tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:03.827792 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-862aa39d-a806-43c1-a937-a587d7a8a64a tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:03.827792 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-862aa39d-a806-43c1-a937-a587d7a8a64a tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:03.827792 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-862aa39d-a806-43c1-a937-a587d7a8a64a tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:03.828297 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-862aa39d-a806-43c1-a937-a587d7a8a64a tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:03.828297 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-862aa39d-a806-43c1-a937-a587d7a8a64a tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:03.874832 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-a3c1493d-7a88-4d62-ae05-370f000bdb05 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:03.875483 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-a3c1493d-7a88-4d62-ae05-370f000bdb05 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 33e0e447-38a7-474d-ae32-1941ee3260c6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:03.882288 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a3c1493d-7a88-4d62-ae05-370f000bdb05 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:03.882785 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a3c1493d-7a88-4d62-ae05-370f000bdb05 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:03.885359 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a3c1493d-7a88-4d62-ae05-370f000bdb05 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:03.885359 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a3c1493d-7a88-4d62-ae05-370f000bdb05 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:03.885359 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a3c1493d-7a88-4d62-ae05-370f000bdb05 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:03.885359 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a3c1493d-7a88-4d62-ae05-370f000bdb05 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:03.972358 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-862aa39d-a806-43c1-a937-a587d7a8a64a tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:03.982446 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-862aa39d-a806-43c1-a937-a587d7a8a64a tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6" status: 200 len: 1504 microversion: 2.1 time: 0.171079 Sep 16 09:54:03.983028 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 251/503] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:03 2022] GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6 => generated 1504 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:54:04.026018 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-a3c1493d-7a88-4d62-ae05-370f000bdb05 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:04.033805 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-a3c1493d-7a88-4d62-ae05-370f000bdb05 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6" status: 200 len: 1682 microversion: 2.1 time: 0.162848 Sep 16 09:54:04.034412 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 253/504] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:03 2022] GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:54:04.356563 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-b48f60a7-7aa7-4f6a-b4c2-bdb1304fe94f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:04.357106 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-b48f60a7-7aa7-4f6a-b4c2-bdb1304fe94f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:04.364102 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b48f60a7-7aa7-4f6a-b4c2-bdb1304fe94f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:04.364588 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b48f60a7-7aa7-4f6a-b4c2-bdb1304fe94f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:04.365039 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b48f60a7-7aa7-4f6a-b4c2-bdb1304fe94f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:04.365785 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b48f60a7-7aa7-4f6a-b4c2-bdb1304fe94f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:04.366250 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b48f60a7-7aa7-4f6a-b4c2-bdb1304fe94f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:04.366727 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b48f60a7-7aa7-4f6a-b4c2-bdb1304fe94f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:04.506545 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-b48f60a7-7aa7-4f6a-b4c2-bdb1304fe94f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:04.515524 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-b48f60a7-7aa7-4f6a-b4c2-bdb1304fe94f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:04.525683 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-b48f60a7-7aa7-4f6a-b4c2-bdb1304fe94f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:04.525683 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-b48f60a7-7aa7-4f6a-b4c2-bdb1304fe94f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1804 microversion: 2.20 time: 0.165850 Sep 16 09:54:04.525683 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 252/505] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:54:04 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1804 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 09:54:04.702154 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-865245e5-61cf-4148-b5b2-303dfd84cb28 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:04.702814 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-865245e5-61cf-4148-b5b2-303dfd84cb28 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] [instance: 20bade93-24eb-4e9e-8851-b3ece7eb6fed] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:04.709996 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-865245e5-61cf-4148-b5b2-303dfd84cb28 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:04.710502 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-865245e5-61cf-4148-b5b2-303dfd84cb28 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:04.710946 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-865245e5-61cf-4148-b5b2-303dfd84cb28 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:04.711681 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-865245e5-61cf-4148-b5b2-303dfd84cb28 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:04.712254 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-865245e5-61cf-4148-b5b2-303dfd84cb28 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:04.712687 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-865245e5-61cf-4148-b5b2-303dfd84cb28 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:04.750034 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-865245e5-61cf-4148-b5b2-303dfd84cb28 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:04.750680 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-865245e5-61cf-4148-b5b2-303dfd84cb28 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:04.751028 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-865245e5-61cf-4148-b5b2-303dfd84cb28 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:04.751496 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.objects.instance [None req-865245e5-61cf-4148-b5b2-303dfd84cb28 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lazy-loading 'fault' on Instance uuid 20bade93-24eb-4e9e-8851-b3ece7eb6fed {{(pid=127670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 09:54:04.795105 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-865245e5-61cf-4148-b5b2-303dfd84cb28 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5c42006d0b442cb41952e5af6354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab67e77307d4b8f926244bc18308358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:04.803937 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-865245e5-61cf-4148-b5b2-303dfd84cb28 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] 10.222.0.73 "GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed" status: 200 len: 1305 microversion: 2.1 time: 0.105639 Sep 16 09:54:04.804780 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 254/506] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:04 2022] GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed => generated 1305 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:54:05.007173 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-5b0e9e8a-8fc3-473f-8cc9-329c60b39aae tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:05.007778 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-5b0e9e8a-8fc3-473f-8cc9-329c60b39aae tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: 60d9ad12-95e0-48c7-8db2-241f7c59cec6] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:05.014247 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5b0e9e8a-8fc3-473f-8cc9-329c60b39aae tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:05.014736 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5b0e9e8a-8fc3-473f-8cc9-329c60b39aae tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:05.015179 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5b0e9e8a-8fc3-473f-8cc9-329c60b39aae tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:05.015863 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5b0e9e8a-8fc3-473f-8cc9-329c60b39aae tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:05.016321 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5b0e9e8a-8fc3-473f-8cc9-329c60b39aae tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:05.016737 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5b0e9e8a-8fc3-473f-8cc9-329c60b39aae tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:05.057774 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-7bb09608-c908-4cf2-94b9-36a92c0d2d7c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:05.058633 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-7bb09608-c908-4cf2-94b9-36a92c0d2d7c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 33e0e447-38a7-474d-ae32-1941ee3260c6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:05.064887 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7bb09608-c908-4cf2-94b9-36a92c0d2d7c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:05.065476 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7bb09608-c908-4cf2-94b9-36a92c0d2d7c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:05.066131 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7bb09608-c908-4cf2-94b9-36a92c0d2d7c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:05.066924 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7bb09608-c908-4cf2-94b9-36a92c0d2d7c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:05.067459 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7bb09608-c908-4cf2-94b9-36a92c0d2d7c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:05.067891 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7bb09608-c908-4cf2-94b9-36a92c0d2d7c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:05.159986 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-5b0e9e8a-8fc3-473f-8cc9-329c60b39aae tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:05.169328 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-5b0e9e8a-8fc3-473f-8cc9-329c60b39aae tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6" status: 200 len: 1504 microversion: 2.1 time: 0.166456 Sep 16 09:54:05.178348 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 253/507] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:05 2022] GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6 => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:54:05.216882 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-7bb09608-c908-4cf2-94b9-36a92c0d2d7c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:05.227514 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-7bb09608-c908-4cf2-94b9-36a92c0d2d7c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6" status: 200 len: 1682 microversion: 2.1 time: 0.173530 Sep 16 09:54:05.228085 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 255/508] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:05 2022] GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6 => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:54:05.544514 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-6cf254d0-3d6e-4c0d-b16e-ab7783a8f04c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:05.545125 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-6cf254d0-3d6e-4c0d-b16e-ab7783a8f04c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:05.551734 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6cf254d0-3d6e-4c0d-b16e-ab7783a8f04c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:05.552229 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6cf254d0-3d6e-4c0d-b16e-ab7783a8f04c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:05.552674 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6cf254d0-3d6e-4c0d-b16e-ab7783a8f04c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:05.553376 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6cf254d0-3d6e-4c0d-b16e-ab7783a8f04c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:05.553878 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6cf254d0-3d6e-4c0d-b16e-ab7783a8f04c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:05.554340 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6cf254d0-3d6e-4c0d-b16e-ab7783a8f04c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:05.685813 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-6cf254d0-3d6e-4c0d-b16e-ab7783a8f04c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:05.694766 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-6cf254d0-3d6e-4c0d-b16e-ab7783a8f04c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:05.696122 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-6cf254d0-3d6e-4c0d-b16e-ab7783a8f04c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:05.697307 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-6cf254d0-3d6e-4c0d-b16e-ab7783a8f04c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1804 microversion: 2.20 time: 0.156879 Sep 16 09:54:05.698178 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 254/509] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:54:05 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1804 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:54:05.828125 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-1e909cf7-1955-47b8-8afb-78b08fa2845d tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:05.828778 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-1e909cf7-1955-47b8-8afb-78b08fa2845d tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] [instance: 20bade93-24eb-4e9e-8851-b3ece7eb6fed] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:05.836207 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1e909cf7-1955-47b8-8afb-78b08fa2845d tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:05.836652 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1e909cf7-1955-47b8-8afb-78b08fa2845d tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:05.837089 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1e909cf7-1955-47b8-8afb-78b08fa2845d tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:05.838029 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1e909cf7-1955-47b8-8afb-78b08fa2845d tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:05.838497 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1e909cf7-1955-47b8-8afb-78b08fa2845d tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:05.838939 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1e909cf7-1955-47b8-8afb-78b08fa2845d tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:05.843208 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:54:05.870704 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1e909cf7-1955-47b8-8afb-78b08fa2845d tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:05.871201 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1e909cf7-1955-47b8-8afb-78b08fa2845d tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:05.871647 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1e909cf7-1955-47b8-8afb-78b08fa2845d tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:05.872100 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.objects.instance [None req-1e909cf7-1955-47b8-8afb-78b08fa2845d tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lazy-loading 'fault' on Instance uuid 20bade93-24eb-4e9e-8851-b3ece7eb6fed {{(pid=127670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 09:54:05.913408 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-1e909cf7-1955-47b8-8afb-78b08fa2845d tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5c42006d0b442cb41952e5af6354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab67e77307d4b8f926244bc18308358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:05.921084 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-1e909cf7-1955-47b8-8afb-78b08fa2845d tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] 10.222.0.73 "GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed" status: 200 len: 1305 microversion: 2.1 time: 0.097114 Sep 16 09:54:05.921657 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 256/510] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:05 2022] GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed => generated 1305 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:54:06.194297 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-d94e39d3-4d4c-4dce-a800-cfb568c47baa tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:06.194958 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-d94e39d3-4d4c-4dce-a800-cfb568c47baa tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: 60d9ad12-95e0-48c7-8db2-241f7c59cec6] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:06.201418 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d94e39d3-4d4c-4dce-a800-cfb568c47baa tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:06.201882 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d94e39d3-4d4c-4dce-a800-cfb568c47baa tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:06.202329 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d94e39d3-4d4c-4dce-a800-cfb568c47baa tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:06.203026 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d94e39d3-4d4c-4dce-a800-cfb568c47baa tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:06.203490 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d94e39d3-4d4c-4dce-a800-cfb568c47baa tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:06.203920 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d94e39d3-4d4c-4dce-a800-cfb568c47baa tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:06.252278 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-452d3736-2022-40f0-9ded-99071ce77fe2 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:06.253715 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-452d3736-2022-40f0-9ded-99071ce77fe2 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 33e0e447-38a7-474d-ae32-1941ee3260c6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:06.260277 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-452d3736-2022-40f0-9ded-99071ce77fe2 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:06.264102 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-452d3736-2022-40f0-9ded-99071ce77fe2 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:06.264102 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-452d3736-2022-40f0-9ded-99071ce77fe2 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:06.264102 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-452d3736-2022-40f0-9ded-99071ce77fe2 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:06.264102 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-452d3736-2022-40f0-9ded-99071ce77fe2 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:06.264449 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-452d3736-2022-40f0-9ded-99071ce77fe2 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:06.339546 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-d94e39d3-4d4c-4dce-a800-cfb568c47baa tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:06.350061 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-d94e39d3-4d4c-4dce-a800-cfb568c47baa tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6" status: 200 len: 1504 microversion: 2.1 time: 0.160160 Sep 16 09:54:06.350640 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 255/511] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:06 2022] GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6 => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:54:06.404231 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-452d3736-2022-40f0-9ded-99071ce77fe2 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:06.412674 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-452d3736-2022-40f0-9ded-99071ce77fe2 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6" status: 200 len: 1682 microversion: 2.1 time: 0.164219 Sep 16 09:54:06.413244 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 257/512] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:06 2022] GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:54:06.723612 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-85876e42-ecc8-44be-81ac-970d2c820a87 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:06.724149 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-85876e42-ecc8-44be-81ac-970d2c820a87 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:06.730283 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-85876e42-ecc8-44be-81ac-970d2c820a87 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:06.730943 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-85876e42-ecc8-44be-81ac-970d2c820a87 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:06.731375 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-85876e42-ecc8-44be-81ac-970d2c820a87 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:06.732074 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-85876e42-ecc8-44be-81ac-970d2c820a87 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:06.732537 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-85876e42-ecc8-44be-81ac-970d2c820a87 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:06.732967 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-85876e42-ecc8-44be-81ac-970d2c820a87 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:06.870579 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-85876e42-ecc8-44be-81ac-970d2c820a87 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:06.880308 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-85876e42-ecc8-44be-81ac-970d2c820a87 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:06.882082 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-85876e42-ecc8-44be-81ac-970d2c820a87 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:06.884661 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-85876e42-ecc8-44be-81ac-970d2c820a87 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1804 microversion: 2.20 time: 0.165069 Sep 16 09:54:06.884661 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 256/513] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:54:06 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1804 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:54:06.944442 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-f1183605-b9a4-497a-aaa7-389c7c7c4477 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:06.945062 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-f1183605-b9a4-497a-aaa7-389c7c7c4477 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] [instance: 20bade93-24eb-4e9e-8851-b3ece7eb6fed] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:06.951379 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f1183605-b9a4-497a-aaa7-389c7c7c4477 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:06.951862 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f1183605-b9a4-497a-aaa7-389c7c7c4477 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:06.952302 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f1183605-b9a4-497a-aaa7-389c7c7c4477 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:06.952994 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f1183605-b9a4-497a-aaa7-389c7c7c4477 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:06.953453 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f1183605-b9a4-497a-aaa7-389c7c7c4477 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:06.953907 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f1183605-b9a4-497a-aaa7-389c7c7c4477 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:06.988436 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f1183605-b9a4-497a-aaa7-389c7c7c4477 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:06.988436 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f1183605-b9a4-497a-aaa7-389c7c7c4477 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:06.989142 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f1183605-b9a4-497a-aaa7-389c7c7c4477 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:06.989142 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.objects.instance [None req-f1183605-b9a4-497a-aaa7-389c7c7c4477 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lazy-loading 'fault' on Instance uuid 20bade93-24eb-4e9e-8851-b3ece7eb6fed {{(pid=127670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 09:54:07.034041 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f1183605-b9a4-497a-aaa7-389c7c7c4477 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5c42006d0b442cb41952e5af6354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab67e77307d4b8f926244bc18308358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:07.043289 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-f1183605-b9a4-497a-aaa7-389c7c7c4477 tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] 10.222.0.73 "GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed" status: 200 len: 1305 microversion: 2.1 time: 0.103679 Sep 16 09:54:07.043863 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 258/514] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:06 2022] GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed => generated 1305 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:54:07.374592 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-544262e1-9fbb-4e9d-9d5f-a3783ecc9446 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:07.375214 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-544262e1-9fbb-4e9d-9d5f-a3783ecc9446 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: 60d9ad12-95e0-48c7-8db2-241f7c59cec6] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:07.383411 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-544262e1-9fbb-4e9d-9d5f-a3783ecc9446 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:07.383894 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-544262e1-9fbb-4e9d-9d5f-a3783ecc9446 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:07.384647 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-544262e1-9fbb-4e9d-9d5f-a3783ecc9446 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:07.386627 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-544262e1-9fbb-4e9d-9d5f-a3783ecc9446 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:07.386627 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-544262e1-9fbb-4e9d-9d5f-a3783ecc9446 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:07.387779 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-544262e1-9fbb-4e9d-9d5f-a3783ecc9446 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:07.439260 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-ab764634-f15b-4acf-9984-aef1423435f5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:07.440221 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-ab764634-f15b-4acf-9984-aef1423435f5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 33e0e447-38a7-474d-ae32-1941ee3260c6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:07.449286 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ab764634-f15b-4acf-9984-aef1423435f5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:07.450498 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ab764634-f15b-4acf-9984-aef1423435f5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:07.451194 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ab764634-f15b-4acf-9984-aef1423435f5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:07.452186 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ab764634-f15b-4acf-9984-aef1423435f5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:07.453716 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ab764634-f15b-4acf-9984-aef1423435f5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:07.454365 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ab764634-f15b-4acf-9984-aef1423435f5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:07.630075 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-544262e1-9fbb-4e9d-9d5f-a3783ecc9446 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:07.638442 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-544262e1-9fbb-4e9d-9d5f-a3783ecc9446 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6" status: 200 len: 1504 microversion: 2.1 time: 0.268575 Sep 16 09:54:07.639123 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 257/515] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:07 2022] GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6 => generated 1504 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:54:07.696971 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-ab764634-f15b-4acf-9984-aef1423435f5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:07.705831 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-ab764634-f15b-4acf-9984-aef1423435f5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6" status: 200 len: 1682 microversion: 2.1 time: 0.272854 Sep 16 09:54:07.707360 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 259/516] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:07 2022] GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6 => generated 1682 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:54:07.912061 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-8a03eb6f-9363-4138-9a25-db0f5cf4410f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:07.913006 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-8a03eb6f-9363-4138-9a25-db0f5cf4410f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:07.919662 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8a03eb6f-9363-4138-9a25-db0f5cf4410f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:07.920147 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8a03eb6f-9363-4138-9a25-db0f5cf4410f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:07.920587 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8a03eb6f-9363-4138-9a25-db0f5cf4410f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:07.921614 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8a03eb6f-9363-4138-9a25-db0f5cf4410f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:07.922093 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8a03eb6f-9363-4138-9a25-db0f5cf4410f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:07.922525 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8a03eb6f-9363-4138-9a25-db0f5cf4410f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:08.066668 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-cba9c014-dab5-4bdc-9768-0a4b071a852b tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:08.066917 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-8a03eb6f-9363-4138-9a25-db0f5cf4410f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:08.067340 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-cba9c014-dab5-4bdc-9768-0a4b071a852b tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] [instance: 20bade93-24eb-4e9e-8851-b3ece7eb6fed] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:08.074756 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cba9c014-dab5-4bdc-9768-0a4b071a852b tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:08.075790 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cba9c014-dab5-4bdc-9768-0a4b071a852b tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:08.076466 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cba9c014-dab5-4bdc-9768-0a4b071a852b tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:08.077415 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cba9c014-dab5-4bdc-9768-0a4b071a852b tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:08.078066 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-8a03eb6f-9363-4138-9a25-db0f5cf4410f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:08.081261 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cba9c014-dab5-4bdc-9768-0a4b071a852b tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:08.081261 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cba9c014-dab5-4bdc-9768-0a4b071a852b tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:08.081485 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-8a03eb6f-9363-4138-9a25-db0f5cf4410f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:08.083188 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-8a03eb6f-9363-4138-9a25-db0f5cf4410f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1804 microversion: 2.20 time: 0.173335 Sep 16 09:54:08.098515 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 258/517] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:54:07 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1804 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:54:08.101211 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.wsgi [None req-cba9c014-dab5-4bdc-9768-0a4b071a852b tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] HTTP exception thrown: Instance 20bade93-24eb-4e9e-8851-b3ece7eb6fed could not be found. Sep 16 09:54:08.103069 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-cba9c014-dab5-4bdc-9768-0a4b071a852b tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Request method failure captured: Sep 16 09:54:08.103069 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: request: GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed HTTP/1.1 Sep 16 09:54:08.103069 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept: application/json Sep 16 09:54:08.103069 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Sep 16 09:54:08.103069 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Connection: close Sep 16 09:54:08.103069 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Length: 0 Sep 16 09:54:08.103069 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Type: application/json Sep 16 09:54:08.103069 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Host: 10.222.0.73 Sep 16 09:54:08.103069 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Sep 16 09:54:08.103069 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Sep 16 09:54:08.103069 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjJEeHFVKrfoCBGVbCMT035JtfJKZCQ6ROLN8wSdyH4ovTY5vX784RlQa3orj7VFKu-9vBbBSxnP0Adu-h4am7_cv0xLYZjnJ3V9RwQ0q9no6Ot7-GkBrb2bGi1fHp0vdR8JMWS0i5gPyy5S76bNOU4_kNrXuvpCqPka_bH9Czo73t1_4 Sep 16 09:54:08.103069 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Sep 16 09:54:08.103069 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Sep 16 09:54:08.103069 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Sep 16 09:54:08.103069 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Sep 16 09:54:08.103069 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Sep 16 09:54:08.103069 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Sep 16 09:54:08.103069 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Id: 9ab67e77307d4b8f926244bc18308358 Sep 16 09:54:08.103069 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-VolumesNegativeTest-1516098509 Sep 16 09:54:08.103069 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Role: reader,member Sep 16 09:54:08.103069 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Roles: reader,member Sep 16 09:54:08.110039 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9ab67e77307d4b8f926244bc18308358"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_9ab67e77307d4b8f926244bc18308358", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9ab67e77307d4b8f926244bc18308358"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/9ab67e77307d4b8f926244bc18308358"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 09:54:08.110039 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-VolumesNegativeTest-1516098509 Sep 16 09:54:08.110039 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Id: 9ab67e77307d4b8f926244bc18308358 Sep 16 09:54:08.110039 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-VolumesNegativeTest-1516098509 Sep 16 09:54:08.110039 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User: tempest-VolumesNegativeTest-1516098509-project Sep 16 09:54:08.110039 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Sep 16 09:54:08.110039 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Sep 16 09:54:08.110039 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Id: fa5c42006d0b442cb41952e5af6354c8 Sep 16 09:54:08.110039 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-VolumesNegativeTest-1516098509-project Sep 16 09:54:08.110039 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: method: > Sep 16 09:54:08.110039 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: exception: Instance 20bade93-24eb-4e9e-8851-b3ece7eb6fed could not be found. Sep 16 09:54:08.110039 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: action_args: {'id': '20bade93-24eb-4e9e-8851-b3ece7eb6fed'} Sep 16 09:54:08.111378 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 09:54:08.111378 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:54:08.111378 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 09:54:08.111378 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 09:54:08.111378 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 09:54:08.111378 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 09:54:08.111378 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 09:54:08.111378 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 09:54:08.111378 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 09:54:08.111378 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 09:54:08.111378 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20bade93-24eb-4e9e-8851-b3ece7eb6fed could not be found. Sep 16 09:54:08.111378 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:54:08.111378 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:54:08.111378 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:54:08.111378 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:54:08.111378 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:54:08.111378 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:54:08.111378 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 09:54:08.111378 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 09:54:08.111378 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 09:54:08.113449 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:54:08.113449 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 09:54:08.113449 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 09:54:08.113449 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 09:54:08.113449 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 09:54:08.113449 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 09:54:08.113449 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 09:54:08.113449 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20bade93-24eb-4e9e-8851-b3ece7eb6fed could not be found. Sep 16 09:54:08.113449 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:54:08.113449 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:54:08.113449 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:54:08.113449 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:54:08.113449 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:54:08.113449 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:54:08.113449 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 09:54:08.113449 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 09:54:08.113449 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20bade93-24eb-4e9e-8851-b3ece7eb6fed could not be found. Sep 16 09:54:08.113449 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:54:08.114895 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-cba9c014-dab5-4bdc-9768-0a4b071a852b tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] Returning 404 to user: Instance 20bade93-24eb-4e9e-8851-b3ece7eb6fed could not be found. {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 09:54:08.114895 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-cba9c014-dab5-4bdc-9768-0a4b071a852b tempest-VolumesNegativeTest-1516098509 tempest-VolumesNegativeTest-1516098509-project] 10.222.0.73 "GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed" status: 404 len: 111 microversion: 2.1 time: 0.042380 Sep 16 09:54:08.114895 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 260/518] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:08 2022] GET /compute/v2.1/servers/20bade93-24eb-4e9e-8851-b3ece7eb6fed => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 09:54:08.174380 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [req-c3f77128-978a-4fa0-912b-7ab4ecca3af0 req-244e5bc3-c3f0-4192-b7bb-0c22c8dd40ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60d9ad12-95e0-48c7-8db2-241f7c59cec6", "name": "network-vif-deleted", "tag": "e2f73010-dd79-4f94-88e0-b0b0a4af8ed6"}]} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:54:08.187972 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-c3f77128-978a-4fa0-912b-7ab4ecca3af0 req-244e5bc3-c3f0-4192-b7bb-0c22c8dd40ec service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:08.189079 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-c3f77128-978a-4fa0-912b-7ab4ecca3af0 req-244e5bc3-c3f0-4192-b7bb-0c22c8dd40ec service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:08.189885 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-c3f77128-978a-4fa0-912b-7ab4ecca3af0 req-244e5bc3-c3f0-4192-b7bb-0c22c8dd40ec service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:08.203413 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.compute.server_external_events [req-c3f77128-978a-4fa0-912b-7ab4ecca3af0 req-244e5bc3-c3f0-4192-b7bb-0c22c8dd40ec service nova] Creating event network-vif-deleted:e2f73010-dd79-4f94-88e0-b0b0a4af8ed6 for instance 60d9ad12-95e0-48c7-8db2-241f7c59cec6 on hv-cinder-79053 Sep 16 09:54:08.208902 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [req-c3f77128-978a-4fa0-912b-7ab4ecca3af0 req-244e5bc3-c3f0-4192-b7bb-0c22c8dd40ec service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038105 Sep 16 09:54:08.209500 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 259/519] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:54:08.548807 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-a7a838f9-dd4f-4f55-bdcc-1dcf6ae60913 req-8bb31d57-b23e-47c2-b91f-e9164b39d753 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33e0e447-38a7-474d-ae32-1941ee3260c6", "name": "network-vif-deleted", "tag": "4108db2f-5c49-4ad6-ae61-afd84b76a0ce"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:54:08.567318 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-a7a838f9-dd4f-4f55-bdcc-1dcf6ae60913 req-8bb31d57-b23e-47c2-b91f-e9164b39d753 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:08.569532 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-a7a838f9-dd4f-4f55-bdcc-1dcf6ae60913 req-8bb31d57-b23e-47c2-b91f-e9164b39d753 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:08.569532 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-a7a838f9-dd4f-4f55-bdcc-1dcf6ae60913 req-8bb31d57-b23e-47c2-b91f-e9164b39d753 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:08.593611 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-a7a838f9-dd4f-4f55-bdcc-1dcf6ae60913 req-8bb31d57-b23e-47c2-b91f-e9164b39d753 service nova] Creating event network-vif-deleted:4108db2f-5c49-4ad6-ae61-afd84b76a0ce for instance 33e0e447-38a7-474d-ae32-1941ee3260c6 on hv-cinder-79053 Sep 16 09:54:08.605490 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-a7a838f9-dd4f-4f55-bdcc-1dcf6ae60913 req-8bb31d57-b23e-47c2-b91f-e9164b39d753 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062968 Sep 16 09:54:08.606883 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 261/520] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 09:54:08.673444 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-67078ef9-3a6f-4319-a03f-69bdd7dee171 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:08.673444 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-67078ef9-3a6f-4319-a03f-69bdd7dee171 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: 60d9ad12-95e0-48c7-8db2-241f7c59cec6] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:08.674215 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-67078ef9-3a6f-4319-a03f-69bdd7dee171 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:08.674644 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-67078ef9-3a6f-4319-a03f-69bdd7dee171 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:08.675526 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-67078ef9-3a6f-4319-a03f-69bdd7dee171 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:08.676359 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-67078ef9-3a6f-4319-a03f-69bdd7dee171 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:08.677012 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-67078ef9-3a6f-4319-a03f-69bdd7dee171 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:08.677570 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-67078ef9-3a6f-4319-a03f-69bdd7dee171 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:08.734281 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-67078ef9-3a6f-4319-a03f-69bdd7dee171 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:08.735421 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-67078ef9-3a6f-4319-a03f-69bdd7dee171 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:08.736336 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-67078ef9-3a6f-4319-a03f-69bdd7dee171 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:08.737241 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.objects.instance [None req-67078ef9-3a6f-4319-a03f-69bdd7dee171 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lazy-loading 'fault' on Instance uuid 60d9ad12-95e0-48c7-8db2-241f7c59cec6 {{(pid=127671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 09:54:08.741871 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-09de6a02-87c3-4df8-858f-8abc870fbfb9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:08.742772 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-09de6a02-87c3-4df8-858f-8abc870fbfb9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 33e0e447-38a7-474d-ae32-1941ee3260c6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:08.753450 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-09de6a02-87c3-4df8-858f-8abc870fbfb9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:08.753987 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-09de6a02-87c3-4df8-858f-8abc870fbfb9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:08.754812 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-09de6a02-87c3-4df8-858f-8abc870fbfb9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:08.757158 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-09de6a02-87c3-4df8-858f-8abc870fbfb9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:08.758655 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-09de6a02-87c3-4df8-858f-8abc870fbfb9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:08.759901 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-09de6a02-87c3-4df8-858f-8abc870fbfb9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:08.834046 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-67078ef9-3a6f-4319-a03f-69bdd7dee171 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08285b64824b40d384df767c993db55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c83ab03cd40d6a1ffcc3d5b369d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:08.844621 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-67078ef9-3a6f-4319-a03f-69bdd7dee171 tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6" status: 200 len: 1304 microversion: 2.1 time: 0.184095 Sep 16 09:54:08.847244 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 260/521] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:08 2022] GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6 => generated 1304 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:54:08.975513 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-09de6a02-87c3-4df8-858f-8abc870fbfb9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:08.985198 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-09de6a02-87c3-4df8-858f-8abc870fbfb9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6" status: 200 len: 1326 microversion: 2.1 time: 0.253489 Sep 16 09:54:08.988705 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 262/522] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:08 2022] GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6 => generated 1326 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:54:09.110673 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-09bd1780-8eb6-456a-bca4-8222248f660d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:09.111568 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-09bd1780-8eb6-456a-bca4-8222248f660d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:09.124013 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-09bd1780-8eb6-456a-bca4-8222248f660d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:09.124949 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-09bd1780-8eb6-456a-bca4-8222248f660d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:09.125633 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-09bd1780-8eb6-456a-bca4-8222248f660d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:09.129954 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-09bd1780-8eb6-456a-bca4-8222248f660d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:09.130721 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-09bd1780-8eb6-456a-bca4-8222248f660d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:09.139408 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-09bd1780-8eb6-456a-bca4-8222248f660d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:09.380629 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-09bd1780-8eb6-456a-bca4-8222248f660d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:09.411630 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-09bd1780-8eb6-456a-bca4-8222248f660d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:09.412213 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-09bd1780-8eb6-456a-bca4-8222248f660d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:09.416395 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-09bd1780-8eb6-456a-bca4-8222248f660d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1804 microversion: 2.20 time: 0.310305 Sep 16 09:54:09.417760 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 261/523] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:54:09 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1804 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 09:54:09.873778 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-178662f5-0701-4b64-b4fa-958465ca0aed tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:09.876287 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-178662f5-0701-4b64-b4fa-958465ca0aed tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] [instance: 60d9ad12-95e0-48c7-8db2-241f7c59cec6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:09.885596 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-178662f5-0701-4b64-b4fa-958465ca0aed tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:09.886402 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-178662f5-0701-4b64-b4fa-958465ca0aed tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:09.886991 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-178662f5-0701-4b64-b4fa-958465ca0aed tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:09.887849 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-178662f5-0701-4b64-b4fa-958465ca0aed tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:09.888458 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-178662f5-0701-4b64-b4fa-958465ca0aed tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:09.889130 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-178662f5-0701-4b64-b4fa-958465ca0aed tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:09.911404 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [req-cad1382b-20fb-4aac-bf5d-c9cdf0335395 req-9d2a4943-73bf-4e32-9924-654c4ea435ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88a0813e-ace7-48df-b688-533c8dbc81de", "name": "network-vif-plugged", "status": "completed", "tag": "55883b34-2ac0-4ba3-b4af-c5503b0d8fc9"}]} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:54:09.961269 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.wsgi [None req-178662f5-0701-4b64-b4fa-958465ca0aed tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] HTTP exception thrown: Instance 60d9ad12-95e0-48c7-8db2-241f7c59cec6 could not be found. Sep 16 09:54:09.964517 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-178662f5-0701-4b64-b4fa-958465ca0aed tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Request method failure captured: Sep 16 09:54:09.964517 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: request: GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6 HTTP/1.1 Sep 16 09:54:09.964517 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept: application/json Sep 16 09:54:09.964517 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Sep 16 09:54:09.964517 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Connection: close Sep 16 09:54:09.964517 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Length: 0 Sep 16 09:54:09.964517 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Type: application/json Sep 16 09:54:09.964517 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Host: 10.222.0.73 Sep 16 09:54:09.964517 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Sep 16 09:54:09.964517 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Sep 16 09:54:09.964517 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjJEdphSZwvzoT2-lqCThGchFxdcb0TqvZJ5ZydxAP3-pz3hqE3toZz2qpH9SiQILDLAl0t1Jdl8KqR8G1aQwqcZJhCIEwaZ_l8J0WdAtxrJzJ6EfH81zFHazBukwO3B2t6DEDF-CCKNN5qe9iRDRw9GsAkN6DrKQ_gOaNepdw-KaNZJ8 Sep 16 09:54:09.964517 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Sep 16 09:54:09.964517 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Sep 16 09:54:09.964517 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Sep 16 09:54:09.964517 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Sep 16 09:54:09.964517 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Sep 16 09:54:09.964517 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Sep 16 09:54:09.964517 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Id: 6e0c83ab03cd40d6a1ffcc3d5b369d64 Sep 16 09:54:09.964517 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-VolumesActionsTest-1001428782 Sep 16 09:54:09.964517 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Role: reader,member Sep 16 09:54:09.964517 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Roles: reader,member Sep 16 09:54:09.966119 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6e0c83ab03cd40d6a1ffcc3d5b369d64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6e0c83ab03cd40d6a1ffcc3d5b369d64", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6e0c83ab03cd40d6a1ffcc3d5b369d64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6e0c83ab03cd40d6a1ffcc3d5b369d64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 09:54:09.966119 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-VolumesActionsTest-1001428782 Sep 16 09:54:09.966119 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Id: 6e0c83ab03cd40d6a1ffcc3d5b369d64 Sep 16 09:54:09.966119 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-VolumesActionsTest-1001428782 Sep 16 09:54:09.966119 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User: tempest-VolumesActionsTest-1001428782-project Sep 16 09:54:09.966119 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Sep 16 09:54:09.966119 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Sep 16 09:54:09.966119 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Id: 08285b64824b40d384df767c993db55b Sep 16 09:54:09.966119 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-VolumesActionsTest-1001428782-project Sep 16 09:54:09.966119 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: method: > Sep 16 09:54:09.966119 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: exception: Instance 60d9ad12-95e0-48c7-8db2-241f7c59cec6 could not be found. Sep 16 09:54:09.966119 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: action_args: {'id': '60d9ad12-95e0-48c7-8db2-241f7c59cec6'} Sep 16 09:54:09.967117 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 09:54:09.967117 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:54:09.967117 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 09:54:09.967117 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 09:54:09.967117 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 09:54:09.967117 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 09:54:09.967117 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 09:54:09.967117 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 09:54:09.967117 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 09:54:09.967117 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 09:54:09.967117 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60d9ad12-95e0-48c7-8db2-241f7c59cec6 could not be found. Sep 16 09:54:09.967117 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:54:09.967117 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:54:09.967117 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:54:09.967117 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:54:09.967117 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:54:09.967117 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:54:09.967117 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 09:54:09.967117 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 09:54:09.967117 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 09:54:09.968289 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:54:09.968289 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 09:54:09.968289 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 09:54:09.968289 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 09:54:09.968289 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 09:54:09.968289 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 09:54:09.968289 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 09:54:09.968289 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60d9ad12-95e0-48c7-8db2-241f7c59cec6 could not be found. Sep 16 09:54:09.968289 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:54:09.968289 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:54:09.968289 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:54:09.968289 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:54:09.968289 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:54:09.968289 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:54:09.968289 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 09:54:09.968289 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 09:54:09.968289 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60d9ad12-95e0-48c7-8db2-241f7c59cec6 could not be found. Sep 16 09:54:09.968289 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:54:09.974203 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-cad1382b-20fb-4aac-bf5d-c9cdf0335395 req-9d2a4943-73bf-4e32-9924-654c4ea435ee service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:09.974726 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-cad1382b-20fb-4aac-bf5d-c9cdf0335395 req-9d2a4943-73bf-4e32-9924-654c4ea435ee service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:09.975173 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-cad1382b-20fb-4aac-bf5d-c9cdf0335395 req-9d2a4943-73bf-4e32-9924-654c4ea435ee service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:09.981132 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-178662f5-0701-4b64-b4fa-958465ca0aed tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] Returning 404 to user: Instance 60d9ad12-95e0-48c7-8db2-241f7c59cec6 could not be found. {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 09:54:09.982061 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-178662f5-0701-4b64-b4fa-958465ca0aed tempest-VolumesActionsTest-1001428782 tempest-VolumesActionsTest-1001428782-project] 10.222.0.73 "GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6" status: 404 len: 111 microversion: 2.1 time: 0.112479 Sep 16 09:54:09.982627 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 263/524] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:09 2022] GET /compute/v2.1/servers/60d9ad12-95e0-48c7-8db2-241f7c59cec6 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 09:54:10.012366 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-1f4d927b-154c-4fc5-be89-58dc245a380f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:10.013000 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-1f4d927b-154c-4fc5-be89-58dc245a380f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 33e0e447-38a7-474d-ae32-1941ee3260c6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:10.016854 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.compute.server_external_events [req-cad1382b-20fb-4aac-bf5d-c9cdf0335395 req-9d2a4943-73bf-4e32-9924-654c4ea435ee service nova] Creating event network-vif-plugged:55883b34-2ac0-4ba3-b4af-c5503b0d8fc9 for instance 88a0813e-ace7-48df-b688-533c8dbc81de on hv-cinder-79053 Sep 16 09:54:10.023197 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:54:10.025743 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [req-cad1382b-20fb-4aac-bf5d-c9cdf0335395 req-9d2a4943-73bf-4e32-9924-654c4ea435ee service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120084 Sep 16 09:54:10.028552 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1f4d927b-154c-4fc5-be89-58dc245a380f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:10.030149 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1f4d927b-154c-4fc5-be89-58dc245a380f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:10.030423 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 262/525] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:54:10.031823 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1f4d927b-154c-4fc5-be89-58dc245a380f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:10.034322 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1f4d927b-154c-4fc5-be89-58dc245a380f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:10.034878 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1f4d927b-154c-4fc5-be89-58dc245a380f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:10.035626 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1f4d927b-154c-4fc5-be89-58dc245a380f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:10.132262 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1f4d927b-154c-4fc5-be89-58dc245a380f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:10.132772 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1f4d927b-154c-4fc5-be89-58dc245a380f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:10.133291 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1f4d927b-154c-4fc5-be89-58dc245a380f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:10.133858 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.objects.instance [None req-1f4d927b-154c-4fc5-be89-58dc245a380f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lazy-loading 'fault' on Instance uuid 33e0e447-38a7-474d-ae32-1941ee3260c6 {{(pid=127670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 09:54:10.187570 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-1f4d927b-154c-4fc5-be89-58dc245a380f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:10.199658 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-1f4d927b-154c-4fc5-be89-58dc245a380f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6" status: 200 len: 1331 microversion: 2.1 time: 0.191145 Sep 16 09:54:10.200456 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 264/526] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:10 2022] GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6 => generated 1331 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:54:10.445734 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-f9936179-df07-432a-a7c4-4d53ca579bd7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:10.446455 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-f9936179-df07-432a-a7c4-4d53ca579bd7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:10.458368 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f9936179-df07-432a-a7c4-4d53ca579bd7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:10.459026 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f9936179-df07-432a-a7c4-4d53ca579bd7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:10.460774 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f9936179-df07-432a-a7c4-4d53ca579bd7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:10.460774 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f9936179-df07-432a-a7c4-4d53ca579bd7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:10.460980 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f9936179-df07-432a-a7c4-4d53ca579bd7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:10.461589 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f9936179-df07-432a-a7c4-4d53ca579bd7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:10.722323 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-f9936179-df07-432a-a7c4-4d53ca579bd7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:10.749008 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-f9936179-df07-432a-a7c4-4d53ca579bd7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:10.751369 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-f9936179-df07-432a-a7c4-4d53ca579bd7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:10.757236 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-f9936179-df07-432a-a7c4-4d53ca579bd7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1804 microversion: 2.20 time: 0.315782 Sep 16 09:54:10.757901 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 263/527] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:54:10 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1804 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:54:11.232348 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-63f56d38-947e-4820-98c4-dcc45a2765ec tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:11.233057 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-63f56d38-947e-4820-98c4-dcc45a2765ec tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 33e0e447-38a7-474d-ae32-1941ee3260c6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:11.241263 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-63f56d38-947e-4820-98c4-dcc45a2765ec tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:11.241821 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-63f56d38-947e-4820-98c4-dcc45a2765ec tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:11.242278 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-63f56d38-947e-4820-98c4-dcc45a2765ec tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:11.242994 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-63f56d38-947e-4820-98c4-dcc45a2765ec tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:11.243459 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-63f56d38-947e-4820-98c4-dcc45a2765ec tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:11.243897 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-63f56d38-947e-4820-98c4-dcc45a2765ec tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:11.258594 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.wsgi [None req-63f56d38-947e-4820-98c4-dcc45a2765ec tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] HTTP exception thrown: Instance 33e0e447-38a7-474d-ae32-1941ee3260c6 could not be found. Sep 16 09:54:11.260149 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-63f56d38-947e-4820-98c4-dcc45a2765ec tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Request method failure captured: Sep 16 09:54:11.260149 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: request: GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6 HTTP/1.1 Sep 16 09:54:11.260149 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept: application/json Sep 16 09:54:11.260149 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Sep 16 09:54:11.260149 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Connection: close Sep 16 09:54:11.260149 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Length: 0 Sep 16 09:54:11.260149 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Type: application/json Sep 16 09:54:11.260149 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Host: 10.222.0.73 Sep 16 09:54:11.260149 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Sep 16 09:54:11.260149 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Sep 16 09:54:11.260149 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjJEbyIogtO-fgeLO9uv3_XXDwxtVD1eIMLN7x0Q3ZD4pj8hYAM6nbLEwKtYbBaube26iELy7B5lx0xTiRTzRgXZs50v25I7qfb15XuH_i9MG8_BlVJAG6OZoKZu6GI9c8evKltkWyTv3vVrhFavNaXN0ju9i-ZnFY6eOsWcD7CFugHvs Sep 16 09:54:11.260149 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Sep 16 09:54:11.260149 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Sep 16 09:54:11.260149 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Sep 16 09:54:11.260149 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Sep 16 09:54:11.260149 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Sep 16 09:54:11.260149 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Sep 16 09:54:11.260149 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Id: 75007587f92646f686881c2e1bfb7b2d Sep 16 09:54:11.260149 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-AttachVolumeNegativeTest-1478592665 Sep 16 09:54:11.260149 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Role: reader,member Sep 16 09:54:11.260149 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Roles: reader,member Sep 16 09:54:11.261767 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/75007587f92646f686881c2e1bfb7b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_75007587f92646f686881c2e1bfb7b2d", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/75007587f92646f686881c2e1bfb7b2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/75007587f92646f686881c2e1bfb7b2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 09:54:11.261767 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-AttachVolumeNegativeTest-1478592665 Sep 16 09:54:11.261767 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Id: 75007587f92646f686881c2e1bfb7b2d Sep 16 09:54:11.261767 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1478592665 Sep 16 09:54:11.261767 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User: tempest-AttachVolumeNegativeTest-1478592665-project Sep 16 09:54:11.261767 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Sep 16 09:54:11.261767 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Sep 16 09:54:11.261767 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Id: 7dca5726e89343828e25def6e6c274bb Sep 16 09:54:11.261767 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-AttachVolumeNegativeTest-1478592665-project Sep 16 09:54:11.261767 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: method: > Sep 16 09:54:11.261767 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: exception: Instance 33e0e447-38a7-474d-ae32-1941ee3260c6 could not be found. Sep 16 09:54:11.261767 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: action_args: {'id': '33e0e447-38a7-474d-ae32-1941ee3260c6'} Sep 16 09:54:11.262651 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 09:54:11.262651 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:54:11.262651 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 09:54:11.262651 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 09:54:11.262651 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 09:54:11.262651 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 09:54:11.262651 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 09:54:11.262651 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 09:54:11.262651 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 09:54:11.262651 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 09:54:11.262651 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33e0e447-38a7-474d-ae32-1941ee3260c6 could not be found. Sep 16 09:54:11.262651 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:54:11.262651 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:54:11.262651 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:54:11.262651 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:54:11.262651 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:54:11.262651 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:54:11.262651 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 09:54:11.262651 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 09:54:11.262651 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 09:54:11.264192 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:54:11.264192 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 09:54:11.264192 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 09:54:11.264192 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 09:54:11.264192 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 09:54:11.264192 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 09:54:11.264192 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 09:54:11.264192 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33e0e447-38a7-474d-ae32-1941ee3260c6 could not be found. Sep 16 09:54:11.264192 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:54:11.264192 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:54:11.264192 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:54:11.264192 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:54:11.264192 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:54:11.264192 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:54:11.264192 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 09:54:11.264192 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 09:54:11.264192 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33e0e447-38a7-474d-ae32-1941ee3260c6 could not be found. Sep 16 09:54:11.264192 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:54:11.266388 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-63f56d38-947e-4820-98c4-dcc45a2765ec tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Returning 404 to user: Instance 33e0e447-38a7-474d-ae32-1941ee3260c6 could not be found. {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 09:54:11.267273 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-63f56d38-947e-4820-98c4-dcc45a2765ec tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6" status: 404 len: 111 microversion: 2.1 time: 0.039332 Sep 16 09:54:11.267857 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 265/528] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:11 2022] GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 09:54:11.276725 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-41a80201-e236-4637-bea4-4872985a275d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '.version_select at 0x7ffa6dbdc040>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:11.420809 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-41a80201-e236-4637-bea4-4872985a275d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-558716720" status: 202 len: 0 microversion: 2.1 time: 0.147915 Sep 16 09:54:11.430066 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 264/529] 10.222.0.73 () {58 vars in 1218 bytes} [Fri Sep 16 09:54:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-558716720 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 09:54:11.785352 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-48ffe60e-8539-43b0-b561-9bc7d70fa77e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:11.786169 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-48ffe60e-8539-43b0-b561-9bc7d70fa77e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:11.792874 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-48ffe60e-8539-43b0-b561-9bc7d70fa77e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:11.793480 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-48ffe60e-8539-43b0-b561-9bc7d70fa77e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:11.794169 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-48ffe60e-8539-43b0-b561-9bc7d70fa77e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:11.794890 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-48ffe60e-8539-43b0-b561-9bc7d70fa77e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:11.795346 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-48ffe60e-8539-43b0-b561-9bc7d70fa77e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:11.795770 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-48ffe60e-8539-43b0-b561-9bc7d70fa77e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:11.939862 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-48ffe60e-8539-43b0-b561-9bc7d70fa77e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:11.949519 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-48ffe60e-8539-43b0-b561-9bc7d70fa77e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:11.958826 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-48ffe60e-8539-43b0-b561-9bc7d70fa77e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:11.958826 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-48ffe60e-8539-43b0-b561-9bc7d70fa77e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1804 microversion: 2.20 time: 0.172228 Sep 16 09:54:11.958826 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 266/530] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:54:11 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1804 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:54:12.668253 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-caa8647c-fc77-4a11-b7c3-b24fe0856b9a tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:12.668777 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-caa8647c-fc77-4a11-b7c3-b24fe0856b9a tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: efec4ecb-65e7-4ca8-a29f-b87bc9ee1915] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:12.677181 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-caa8647c-fc77-4a11-b7c3-b24fe0856b9a tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:12.677708 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-caa8647c-fc77-4a11-b7c3-b24fe0856b9a tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:12.678158 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-caa8647c-fc77-4a11-b7c3-b24fe0856b9a tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:12.679029 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-caa8647c-fc77-4a11-b7c3-b24fe0856b9a tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:12.679322 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-caa8647c-fc77-4a11-b7c3-b24fe0856b9a tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:12.679752 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-caa8647c-fc77-4a11-b7c3-b24fe0856b9a tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:12.831690 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.objects.instance [None req-caa8647c-fc77-4a11-b7c3-b24fe0856b9a tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lazy-loading 'services' on Instance uuid efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 {{(pid=127671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 09:54:12.984470 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d67ca6bc-3b5b-48da-858c-171b4bf5a550 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:12.984470 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-d67ca6bc-3b5b-48da-858c-171b4bf5a550 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:12.986521 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d67ca6bc-3b5b-48da-858c-171b4bf5a550 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:12.987582 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d67ca6bc-3b5b-48da-858c-171b4bf5a550 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:12.988570 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d67ca6bc-3b5b-48da-858c-171b4bf5a550 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:12.989057 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d67ca6bc-3b5b-48da-858c-171b4bf5a550 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:12.989477 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d67ca6bc-3b5b-48da-858c-171b4bf5a550 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:12.989938 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d67ca6bc-3b5b-48da-858c-171b4bf5a550 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:13.129147 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-caa8647c-fc77-4a11-b7c3-b24fe0856b9a tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "DELETE /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915/os-volume_attachments/671204a1-d033-4b52-a5b8-5fe366c8f42b" status: 202 len: 0 microversion: 2.1 time: 0.465791 Sep 16 09:54:13.129779 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 265/531] 10.222.0.73 () {58 vars in 1416 bytes} [Fri Sep 16 09:54:12 2022] DELETE /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915/os-volume_attachments/671204a1-d033-4b52-a5b8-5fe366c8f42b => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 09:54:13.138671 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-5026a88a-85ea-4a58-81bc-b8ac5a9c8917 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:13.141415 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-5026a88a-85ea-4a58-81bc-b8ac5a9c8917 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: efec4ecb-65e7-4ca8-a29f-b87bc9ee1915] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:13.143881 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-d67ca6bc-3b5b-48da-858c-171b4bf5a550 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:13.148631 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5026a88a-85ea-4a58-81bc-b8ac5a9c8917 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:13.149125 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5026a88a-85ea-4a58-81bc-b8ac5a9c8917 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:13.150064 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5026a88a-85ea-4a58-81bc-b8ac5a9c8917 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:13.150979 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5026a88a-85ea-4a58-81bc-b8ac5a9c8917 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:13.151434 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5026a88a-85ea-4a58-81bc-b8ac5a9c8917 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:13.152033 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5026a88a-85ea-4a58-81bc-b8ac5a9c8917 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:13.155037 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-d67ca6bc-3b5b-48da-858c-171b4bf5a550 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:13.157856 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-d67ca6bc-3b5b-48da-858c-171b4bf5a550 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:13.159789 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-d67ca6bc-3b5b-48da-858c-171b4bf5a550 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1804 microversion: 2.20 time: 0.184747 Sep 16 09:54:13.160338 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 267/532] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:54:12 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1804 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 09:54:13.186386 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-5026a88a-85ea-4a58-81bc-b8ac5a9c8917 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052017 Sep 16 09:54:13.186960 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 266/533] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Sep 16 09:54:13 2022] GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 09:54:14.185232 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-fe5fee7b-bae7-40e3-a0de-39c584b18bc4 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:14.185883 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-fe5fee7b-bae7-40e3-a0de-39c584b18bc4 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:14.192741 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fe5fee7b-bae7-40e3-a0de-39c584b18bc4 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:14.193496 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fe5fee7b-bae7-40e3-a0de-39c584b18bc4 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:14.193989 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fe5fee7b-bae7-40e3-a0de-39c584b18bc4 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:14.194855 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fe5fee7b-bae7-40e3-a0de-39c584b18bc4 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:14.195151 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fe5fee7b-bae7-40e3-a0de-39c584b18bc4 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:14.195580 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fe5fee7b-bae7-40e3-a0de-39c584b18bc4 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:14.198497 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-a84766e7-8ac3-480e-9621-6a916643725d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:14.200651 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-a84766e7-8ac3-480e-9621-6a916643725d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: efec4ecb-65e7-4ca8-a29f-b87bc9ee1915] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:14.207573 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a84766e7-8ac3-480e-9621-6a916643725d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:14.208304 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a84766e7-8ac3-480e-9621-6a916643725d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:14.208932 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a84766e7-8ac3-480e-9621-6a916643725d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:14.209862 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a84766e7-8ac3-480e-9621-6a916643725d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:14.211382 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a84766e7-8ac3-480e-9621-6a916643725d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:14.211382 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a84766e7-8ac3-480e-9621-6a916643725d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:14.216473 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:54:14.249178 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-a84766e7-8ac3-480e-9621-6a916643725d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054528 Sep 16 09:54:14.250092 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 267/534] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Sep 16 09:54:14 2022] GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 09:54:14.357973 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-fe5fee7b-bae7-40e3-a0de-39c584b18bc4 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:14.368543 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-fe5fee7b-bae7-40e3-a0de-39c584b18bc4 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:14.370322 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-fe5fee7b-bae7-40e3-a0de-39c584b18bc4 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:14.371759 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-fe5fee7b-bae7-40e3-a0de-39c584b18bc4 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1804 microversion: 2.20 time: 0.190310 Sep 16 09:54:14.372550 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 268/535] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:54:14 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1804 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:54:15.261650 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-480a046b-c075-4bfc-b054-8804d3968c13 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:15.265319 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-480a046b-c075-4bfc-b054-8804d3968c13 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: efec4ecb-65e7-4ca8-a29f-b87bc9ee1915] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:15.278412 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-480a046b-c075-4bfc-b054-8804d3968c13 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:15.279424 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-480a046b-c075-4bfc-b054-8804d3968c13 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:15.281086 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-480a046b-c075-4bfc-b054-8804d3968c13 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:15.281529 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-480a046b-c075-4bfc-b054-8804d3968c13 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:15.282443 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-480a046b-c075-4bfc-b054-8804d3968c13 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:15.283254 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-480a046b-c075-4bfc-b054-8804d3968c13 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:15.337331 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-480a046b-c075-4bfc-b054-8804d3968c13 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079796 Sep 16 09:54:15.337968 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 268/536] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Sep 16 09:54:15 2022] GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:54:15.399177 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-ca83a332-75c6-4d35-98e6-98d1570b4189 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:15.399807 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-ca83a332-75c6-4d35-98e6-98d1570b4189 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:15.408194 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ca83a332-75c6-4d35-98e6-98d1570b4189 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:15.408716 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ca83a332-75c6-4d35-98e6-98d1570b4189 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:15.409889 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ca83a332-75c6-4d35-98e6-98d1570b4189 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:15.411424 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ca83a332-75c6-4d35-98e6-98d1570b4189 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:15.411928 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ca83a332-75c6-4d35-98e6-98d1570b4189 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:15.412413 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ca83a332-75c6-4d35-98e6-98d1570b4189 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:15.551354 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-ca83a332-75c6-4d35-98e6-98d1570b4189 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:15.559972 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-ca83a332-75c6-4d35-98e6-98d1570b4189 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:15.561412 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-ca83a332-75c6-4d35-98e6-98d1570b4189 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:15.562596 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-ca83a332-75c6-4d35-98e6-98d1570b4189 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1791 microversion: 2.20 time: 0.168160 Sep 16 09:54:15.563154 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 269/537] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:54:15 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1791 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:54:16.351069 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-86fa0f55-7f16-46e6-a3b6-d329571e956f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:16.354465 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-86fa0f55-7f16-46e6-a3b6-d329571e956f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: efec4ecb-65e7-4ca8-a29f-b87bc9ee1915] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:16.362012 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-86fa0f55-7f16-46e6-a3b6-d329571e956f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:16.362614 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-86fa0f55-7f16-46e6-a3b6-d329571e956f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:16.363081 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-86fa0f55-7f16-46e6-a3b6-d329571e956f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:16.363795 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-86fa0f55-7f16-46e6-a3b6-d329571e956f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:16.364548 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-86fa0f55-7f16-46e6-a3b6-d329571e956f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:16.365149 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-86fa0f55-7f16-46e6-a3b6-d329571e956f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:16.441173 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-86fa0f55-7f16-46e6-a3b6-d329571e956f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.094862 Sep 16 09:54:16.442191 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 269/538] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Sep 16 09:54:16 2022] GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915/os-volume_attachments => generated 25 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 16 09:54:16.540670 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-6d0489d2-7f07-4818-b648-63064a0bf45d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:16.541450 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-6d0489d2-7f07-4818-b648-63064a0bf45d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: efec4ecb-65e7-4ca8-a29f-b87bc9ee1915] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:16.548445 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6d0489d2-7f07-4818-b648-63064a0bf45d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:16.548969 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6d0489d2-7f07-4818-b648-63064a0bf45d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:16.550976 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6d0489d2-7f07-4818-b648-63064a0bf45d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:16.551987 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6d0489d2-7f07-4818-b648-63064a0bf45d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:16.552776 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6d0489d2-7f07-4818-b648-63064a0bf45d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:16.553477 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6d0489d2-7f07-4818-b648-63064a0bf45d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:16.597991 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-6d0489d2-7f07-4818-b648-63064a0bf45d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: efec4ecb-65e7-4ca8-a29f-b87bc9ee1915] Going to try to terminate instance {{(pid=127670) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 09:54:17.078507 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-6d0489d2-7f07-4818-b648-63064a0bf45d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "DELETE /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915" status: 204 len: 0 microversion: 2.1 time: 0.541584 Sep 16 09:54:17.079209 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 270/539] 10.222.0.73 () {58 vars in 1239 bytes} [Fri Sep 16 09:54:16 2022] DELETE /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 16 09:54:17.088662 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-bf6af763-e666-41c7-a1db-7364580191cf tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:17.089431 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-bf6af763-e666-41c7-a1db-7364580191cf tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: efec4ecb-65e7-4ca8-a29f-b87bc9ee1915] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:17.097801 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-bf6af763-e666-41c7-a1db-7364580191cf tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:17.099071 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-bf6af763-e666-41c7-a1db-7364580191cf tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:17.099717 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-bf6af763-e666-41c7-a1db-7364580191cf tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:17.100857 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-bf6af763-e666-41c7-a1db-7364580191cf tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:17.101570 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-bf6af763-e666-41c7-a1db-7364580191cf tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:17.102346 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-bf6af763-e666-41c7-a1db-7364580191cf tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:17.320507 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-bf6af763-e666-41c7-a1db-7364580191cf tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:17.329973 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-bf6af763-e666-41c7-a1db-7364580191cf tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915" status: 200 len: 1680 microversion: 2.1 time: 0.245868 Sep 16 09:54:17.330598 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 270/540] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:17 2022] GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 => generated 1680 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:54:18.359853 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-89d7b05f-140a-4d7f-807d-1a7191911a51 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:18.361177 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-89d7b05f-140a-4d7f-807d-1a7191911a51 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: efec4ecb-65e7-4ca8-a29f-b87bc9ee1915] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:18.370390 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-89d7b05f-140a-4d7f-807d-1a7191911a51 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:18.371303 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-89d7b05f-140a-4d7f-807d-1a7191911a51 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:18.372366 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-89d7b05f-140a-4d7f-807d-1a7191911a51 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:18.373802 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-89d7b05f-140a-4d7f-807d-1a7191911a51 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:18.374436 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-89d7b05f-140a-4d7f-807d-1a7191911a51 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:18.375195 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-89d7b05f-140a-4d7f-807d-1a7191911a51 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:18.554590 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-89d7b05f-140a-4d7f-807d-1a7191911a51 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:18.586490 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-89d7b05f-140a-4d7f-807d-1a7191911a51 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915" status: 200 len: 1680 microversion: 2.1 time: 0.231113 Sep 16 09:54:18.592850 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 271/541] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:18 2022] GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 => generated 1680 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:54:19.621099 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-1f3ba0b0-1bdc-49f3-8c2e-28c2aa2134ce tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:19.625513 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-1f3ba0b0-1bdc-49f3-8c2e-28c2aa2134ce tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: efec4ecb-65e7-4ca8-a29f-b87bc9ee1915] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:19.642302 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1f3ba0b0-1bdc-49f3-8c2e-28c2aa2134ce tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:19.643570 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1f3ba0b0-1bdc-49f3-8c2e-28c2aa2134ce tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:19.653483 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1f3ba0b0-1bdc-49f3-8c2e-28c2aa2134ce tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:19.653483 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1f3ba0b0-1bdc-49f3-8c2e-28c2aa2134ce tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:19.653483 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1f3ba0b0-1bdc-49f3-8c2e-28c2aa2134ce tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:19.653483 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1f3ba0b0-1bdc-49f3-8c2e-28c2aa2134ce tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:19.951675 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-1f3ba0b0-1bdc-49f3-8c2e-28c2aa2134ce tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:19.966185 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-1f3ba0b0-1bdc-49f3-8c2e-28c2aa2134ce tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915" status: 200 len: 1680 microversion: 2.1 time: 0.352413 Sep 16 09:54:19.966185 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 271/542] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:19 2022] GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 => generated 1680 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:54:20.615636 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-970fb735-86bc-4c72-b9fb-54269fe19bfe req-4d8df6e9-c787-43e5-9f3e-7d47231101ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efec4ecb-65e7-4ca8-a29f-b87bc9ee1915", "name": "network-vif-deleted", "tag": "70b30d2d-a478-423b-bb6f-8944c8ac74de"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:54:20.630845 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-970fb735-86bc-4c72-b9fb-54269fe19bfe req-4d8df6e9-c787-43e5-9f3e-7d47231101ae service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:20.631360 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-970fb735-86bc-4c72-b9fb-54269fe19bfe req-4d8df6e9-c787-43e5-9f3e-7d47231101ae service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:20.631821 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-970fb735-86bc-4c72-b9fb-54269fe19bfe req-4d8df6e9-c787-43e5-9f3e-7d47231101ae service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:20.660561 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-970fb735-86bc-4c72-b9fb-54269fe19bfe req-4d8df6e9-c787-43e5-9f3e-7d47231101ae service nova] Creating event network-vif-deleted:70b30d2d-a478-423b-bb6f-8944c8ac74de for instance efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 on hv-cinder-79053 Sep 16 09:54:20.674024 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-970fb735-86bc-4c72-b9fb-54269fe19bfe req-4d8df6e9-c787-43e5-9f3e-7d47231101ae service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062042 Sep 16 09:54:20.674846 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 272/543] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:54:20.992608 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-8df742e9-ffb7-44d1-8760-65979853c91d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:20.993910 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-8df742e9-ffb7-44d1-8760-65979853c91d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: efec4ecb-65e7-4ca8-a29f-b87bc9ee1915] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:21.008471 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8df742e9-ffb7-44d1-8760-65979853c91d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:21.011868 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8df742e9-ffb7-44d1-8760-65979853c91d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:21.014333 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8df742e9-ffb7-44d1-8760-65979853c91d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:21.015659 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8df742e9-ffb7-44d1-8760-65979853c91d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:21.019200 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8df742e9-ffb7-44d1-8760-65979853c91d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:21.019869 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8df742e9-ffb7-44d1-8760-65979853c91d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:21.091925 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8df742e9-ffb7-44d1-8760-65979853c91d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:21.092410 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8df742e9-ffb7-44d1-8760-65979853c91d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:21.093209 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8df742e9-ffb7-44d1-8760-65979853c91d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:21.093698 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.objects.instance [None req-8df742e9-ffb7-44d1-8760-65979853c91d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lazy-loading 'fault' on Instance uuid efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 {{(pid=127671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 09:54:21.150235 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-8df742e9-ffb7-44d1-8760-65979853c91d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:21.166034 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-8df742e9-ffb7-44d1-8760-65979853c91d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915" status: 200 len: 1331 microversion: 2.1 time: 0.177692 Sep 16 09:54:21.167002 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 272/544] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:20 2022] GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 => generated 1331 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:54:22.194311 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-e9da69f2-221f-49f2-86c1-8d8e0b33f5a9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:22.210218 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-e9da69f2-221f-49f2-86c1-8d8e0b33f5a9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: efec4ecb-65e7-4ca8-a29f-b87bc9ee1915] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:22.218261 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e9da69f2-221f-49f2-86c1-8d8e0b33f5a9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:22.218763 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e9da69f2-221f-49f2-86c1-8d8e0b33f5a9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:22.219208 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e9da69f2-221f-49f2-86c1-8d8e0b33f5a9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:22.219913 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e9da69f2-221f-49f2-86c1-8d8e0b33f5a9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:22.220382 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e9da69f2-221f-49f2-86c1-8d8e0b33f5a9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:22.220814 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e9da69f2-221f-49f2-86c1-8d8e0b33f5a9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:22.260332 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:54:22.281772 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e9da69f2-221f-49f2-86c1-8d8e0b33f5a9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:22.282278 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e9da69f2-221f-49f2-86c1-8d8e0b33f5a9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:22.282726 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e9da69f2-221f-49f2-86c1-8d8e0b33f5a9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:22.283198 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.objects.instance [None req-e9da69f2-221f-49f2-86c1-8d8e0b33f5a9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lazy-loading 'fault' on Instance uuid efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 {{(pid=127670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 09:54:22.359034 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-e9da69f2-221f-49f2-86c1-8d8e0b33f5a9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:22.363562 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-e9da69f2-221f-49f2-86c1-8d8e0b33f5a9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915" status: 200 len: 1331 microversion: 2.1 time: 0.174341 Sep 16 09:54:22.364737 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 273/545] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:22 2022] GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 => generated 1331 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:54:23.390757 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-9662a517-9581-4a6d-ab64-633102d558bd tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:23.393511 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-9662a517-9581-4a6d-ab64-633102d558bd tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: efec4ecb-65e7-4ca8-a29f-b87bc9ee1915] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:23.401053 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9662a517-9581-4a6d-ab64-633102d558bd tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:23.401672 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9662a517-9581-4a6d-ab64-633102d558bd tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:23.402214 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9662a517-9581-4a6d-ab64-633102d558bd tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:23.403194 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9662a517-9581-4a6d-ab64-633102d558bd tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:23.403903 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9662a517-9581-4a6d-ab64-633102d558bd tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:23.404546 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9662a517-9581-4a6d-ab64-633102d558bd tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:23.421363 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.wsgi [None req-9662a517-9581-4a6d-ab64-633102d558bd tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] HTTP exception thrown: Instance efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 could not be found. Sep 16 09:54:23.423172 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-9662a517-9581-4a6d-ab64-633102d558bd tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Request method failure captured: Sep 16 09:54:23.423172 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: request: GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 HTTP/1.1 Sep 16 09:54:23.423172 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept: application/json Sep 16 09:54:23.423172 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept-Encoding: identity Sep 16 09:54:23.423172 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Connection: close Sep 16 09:54:23.423172 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Length: 0 Sep 16 09:54:23.423172 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Type: application/json Sep 16 09:54:23.423172 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Host: 10.222.0.73 Sep 16 09:54:23.423172 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Openstack-System-Scope: None Sep 16 09:54:23.423172 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: User-Agent: python-urllib3/1.26.12 Sep 16 09:54:23.423172 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Auth-Token: gAAAAABjJEbyIogtO-fgeLO9uv3_XXDwxtVD1eIMLN7x0Q3ZD4pj8hYAM6nbLEwKtYbBaube26iELy7B5lx0xTiRTzRgXZs50v25I7qfb15XuH_i9MG8_BlVJAG6OZoKZu6GI9c8evKltkWyTv3vVrhFavNaXN0ju9i-ZnFY6eOsWcD7CFugHvs Sep 16 09:54:23.423172 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Id: None Sep 16 09:54:23.423172 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Name: None Sep 16 09:54:23.423172 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Identity-Status: Confirmed Sep 16 09:54:23.423172 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Is-Admin-Project: True Sep 16 09:54:23.423172 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Id: default Sep 16 09:54:23.423172 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Name: Default Sep 16 09:54:23.423172 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Id: 75007587f92646f686881c2e1bfb7b2d Sep 16 09:54:23.423172 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Name: tempest-AttachVolumeNegativeTest-1478592665 Sep 16 09:54:23.423172 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Role: reader,member Sep 16 09:54:23.423172 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Roles: reader,member Sep 16 09:54:23.425507 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/75007587f92646f686881c2e1bfb7b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_75007587f92646f686881c2e1bfb7b2d", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/75007587f92646f686881c2e1bfb7b2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/75007587f92646f686881c2e1bfb7b2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 09:54:23.425507 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant: tempest-AttachVolumeNegativeTest-1478592665 Sep 16 09:54:23.425507 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Id: 75007587f92646f686881c2e1bfb7b2d Sep 16 09:54:23.425507 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1478592665 Sep 16 09:54:23.425507 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User: tempest-AttachVolumeNegativeTest-1478592665-project Sep 16 09:54:23.425507 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Id: default Sep 16 09:54:23.425507 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Name: Default Sep 16 09:54:23.425507 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Id: 7dca5726e89343828e25def6e6c274bb Sep 16 09:54:23.425507 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Name: tempest-AttachVolumeNegativeTest-1478592665-project Sep 16 09:54:23.425507 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: method: > Sep 16 09:54:23.425507 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: exception: Instance efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 could not be found. Sep 16 09:54:23.425507 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: action_args: {'id': 'efec4ecb-65e7-4ca8-a29f-b87bc9ee1915'} Sep 16 09:54:23.432902 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 09:54:23.432902 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:54:23.432902 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 09:54:23.432902 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 09:54:23.432902 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 09:54:23.432902 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 09:54:23.432902 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 09:54:23.432902 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 09:54:23.432902 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 09:54:23.432902 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 09:54:23.432902 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 could not be found. Sep 16 09:54:23.432902 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:54:23.432902 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:54:23.432902 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:54:23.432902 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:54:23.432902 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:54:23.432902 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:54:23.432902 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 09:54:23.432902 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 09:54:23.432902 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 09:54:23.434431 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:54:23.434431 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 09:54:23.434431 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 09:54:23.434431 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 09:54:23.434431 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 09:54:23.434431 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 09:54:23.434431 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 09:54:23.434431 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 could not be found. Sep 16 09:54:23.434431 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:54:23.434431 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:54:23.434431 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:54:23.434431 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:54:23.434431 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:54:23.434431 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:54:23.434431 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 09:54:23.434431 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 09:54:23.434431 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 could not be found. Sep 16 09:54:23.434431 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:54:23.438197 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-9662a517-9581-4a6d-ab64-633102d558bd tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Returning 404 to user: Instance efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 could not be found. {{(pid=127671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 09:54:23.438197 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-9662a517-9581-4a6d-ab64-633102d558bd tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915" status: 404 len: 111 microversion: 2.1 time: 0.042854 Sep 16 09:54:23.438197 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 273/546] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:23 2022] GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 09:54:23.439680 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-e8cb334a-ae9b-4973-93bc-978250292218 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '.version_select at 0x7ffa6dd3d670>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:23.537206 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-e8cb334a-ae9b-4973-93bc-978250292218 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1826692380" status: 202 len: 0 microversion: 2.1 time: 0.101558 Sep 16 09:54:23.539083 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 274/547] 10.222.0.73 () {58 vars in 1221 bytes} [Fri Sep 16 09:54:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1826692380 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 09:54:23.617346 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-22879c4a-ee06-40a2-85e3-a870aaa3e22d tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1744540267", "imageRef": "30d28050-ec9d-4227-9bb0-5247430f6177", "flavorRef": "452", "networks": [{"uuid": "80ad130f-ee94-4395-b6b0-46a52c3f8f24"}]}} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:54:23.686894 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.network.neutron [None req-22879c4a-ee06-40a2-85e3-a870aaa3e22d tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] validate_networks() for [('80ad130f-ee94-4395-b6b0-46a52c3f8f24', None, None, None, None, None)] {{(pid=127671) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 09:54:24.147846 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.virt.hardware [None req-22879c4a-ee06-40a2-85e3-a870aaa3e22d tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Flavor limits 0:0:0 {{(pid=127671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 09:54:24.148257 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.virt.hardware [None req-22879c4a-ee06-40a2-85e3-a870aaa3e22d tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Image limits 0:0:0 {{(pid=127671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 09:54:24.148740 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.virt.hardware [None req-22879c4a-ee06-40a2-85e3-a870aaa3e22d tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Flavor pref 0:0:0 {{(pid=127671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 09:54:24.149160 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.virt.hardware [None req-22879c4a-ee06-40a2-85e3-a870aaa3e22d tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Image pref 0:0:0 {{(pid=127671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 09:54:24.149594 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.virt.hardware [None req-22879c4a-ee06-40a2-85e3-a870aaa3e22d tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 09:54:24.162123 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-22879c4a-ee06-40a2-85e3-a870aaa3e22d tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:24.162771 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-22879c4a-ee06-40a2-85e3-a870aaa3e22d tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:24.163376 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-22879c4a-ee06-40a2-85e3-a870aaa3e22d tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:24.164128 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-22879c4a-ee06-40a2-85e3-a870aaa3e22d tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:24.164579 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-22879c4a-ee06-40a2-85e3-a870aaa3e22d tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:24.167656 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-22879c4a-ee06-40a2-85e3-a870aaa3e22d tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:24.183730 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.quota [None req-22879c4a-ee06-40a2-85e3-a870aaa3e22d tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Getting quotas for project 01d2a4f111114064aa5a477177e6d1dd. Resources: {'instances', 'cores', 'ram'} {{(pid=127671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 09:54:24.188076 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.quota [None req-22879c4a-ee06-40a2-85e3-a870aaa3e22d tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Getting quotas for user 1142f8595de54bfc8f28a5152eaa00d1 and project 01d2a4f111114064aa5a477177e6d1dd. Resources: {'instances', 'cores', 'ram'} {{(pid=127671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 09:54:24.200869 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-22879c4a-ee06-40a2-85e3-a870aaa3e22d tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Going to run 1 instances... {{(pid=127671) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 09:54:24.203856 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-22879c4a-ee06-40a2-85e3-a870aaa3e22d tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] [instance: 5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='30d28050-ec9d-4227-9bb0-5247430f6177',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 09:54:24.380445 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-22879c4a-ee06-40a2-85e3-a870aaa3e22d tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.766856 Sep 16 09:54:24.381433 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 274/548] 10.222.0.73 () {60 vars in 1147 bytes} [Fri Sep 16 09:54:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 09:54:24.395106 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-52ed3637-3a69-44ce-8c87-d96f29f568ac tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:24.396547 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-52ed3637-3a69-44ce-8c87-d96f29f568ac tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] [instance: 5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:24.555534 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-52ed3637-3a69-44ce-8c87-d96f29f568ac tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1142f8595de54bfc8f28a5152eaa00d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d2a4f111114064aa5a477177e6d1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:24.568931 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-52ed3637-3a69-44ce-8c87-d96f29f568ac tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] 10.222.0.73 "GET /compute/v2.1/servers/5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32" status: 200 len: 1219 microversion: 2.1 time: 0.179832 Sep 16 09:54:24.569590 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 275/549] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:24 2022] GET /compute/v2.1/servers/5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32 => generated 1219 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:54:24.777056 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-1662d971-c8ba-4ca6-9907-89f3ff4d9f89 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Action: 'create', calling method: .version_select at 0x7ffa6dbdc9d0>, body: {"keypair": {"name": "tempest-keypair-1054021645", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPKgwktquR9M7Q/GT0wmswq24fmFO3Qrg+9Ow1TPskQzRNr7X3ROG/EORi85Zysvl2WkisWJT+A1bfOckMSC6ZShq3Ct+bBAjwRSq301e7ZM26Y1re8VfkzXow+n8q/qzw=="}} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:54:24.801638 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.quota [None req-1662d971-c8ba-4ca6-9907-89f3ff4d9f89 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Getting quotas for project 75007587f92646f686881c2e1bfb7b2d. Resources: {'key_pairs'} {{(pid=127671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 09:54:24.806043 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.quota [None req-1662d971-c8ba-4ca6-9907-89f3ff4d9f89 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Getting quotas for user 7dca5726e89343828e25def6e6c274bb and project 75007587f92646f686881c2e1bfb7b2d. Resources: {'key_pairs'} {{(pid=127671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 09:54:24.927387 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-1662d971-c8ba-4ca6-9907-89f3ff4d9f89 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.154788 Sep 16 09:54:24.929207 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 275/550] 10.222.0.73 () {60 vars in 1159 bytes} [Fri Sep 16 09:54:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:54:25.592730 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-133151cf-1a68-4c9a-ae37-d3270af7afef tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:25.593513 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-133151cf-1a68-4c9a-ae37-d3270af7afef tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] [instance: 5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:25.650344 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-133151cf-1a68-4c9a-ae37-d3270af7afef tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1142f8595de54bfc8f28a5152eaa00d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d2a4f111114064aa5a477177e6d1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:25.670382 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-133151cf-1a68-4c9a-ae37-d3270af7afef tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] 10.222.0.73 "GET /compute/v2.1/servers/5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32" status: 200 len: 1219 microversion: 2.1 time: 0.081853 Sep 16 09:54:25.672163 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 276/551] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:25 2022] GET /compute/v2.1/servers/5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:54:26.704214 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-7a701ed8-9bfd-432e-b138-fa7898e488fc tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:26.706367 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-7a701ed8-9bfd-432e-b138-fa7898e488fc tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] [instance: 5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:26.718909 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:54:26.722954 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7a701ed8-9bfd-432e-b138-fa7898e488fc tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:26.724476 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7a701ed8-9bfd-432e-b138-fa7898e488fc tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:26.727172 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7a701ed8-9bfd-432e-b138-fa7898e488fc tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:26.729057 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7a701ed8-9bfd-432e-b138-fa7898e488fc tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:26.729794 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7a701ed8-9bfd-432e-b138-fa7898e488fc tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:26.732453 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7a701ed8-9bfd-432e-b138-fa7898e488fc tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:26.871291 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-7a701ed8-9bfd-432e-b138-fa7898e488fc tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1142f8595de54bfc8f28a5152eaa00d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d2a4f111114064aa5a477177e6d1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:26.884135 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-7a701ed8-9bfd-432e-b138-fa7898e488fc tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] 10.222.0.73 "GET /compute/v2.1/servers/5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32" status: 200 len: 1271 microversion: 2.1 time: 0.185344 Sep 16 09:54:26.898851 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 276/552] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:26 2022] GET /compute/v2.1/servers/5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32 => generated 1271 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:54:27.910658 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-df18e4e9-00d0-4b2d-a720-e99a5ac149ab tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:27.911885 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-df18e4e9-00d0-4b2d-a720-e99a5ac149ab tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] [instance: 5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:27.922469 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-df18e4e9-00d0-4b2d-a720-e99a5ac149ab tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:27.923089 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-df18e4e9-00d0-4b2d-a720-e99a5ac149ab tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:27.923620 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-df18e4e9-00d0-4b2d-a720-e99a5ac149ab tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:27.931741 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-df18e4e9-00d0-4b2d-a720-e99a5ac149ab tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:27.933084 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-df18e4e9-00d0-4b2d-a720-e99a5ac149ab tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:27.933873 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-df18e4e9-00d0-4b2d-a720-e99a5ac149ab tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:28.100964 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-df18e4e9-00d0-4b2d-a720-e99a5ac149ab tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1142f8595de54bfc8f28a5152eaa00d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d2a4f111114064aa5a477177e6d1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:28.165482 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-df18e4e9-00d0-4b2d-a720-e99a5ac149ab tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] 10.222.0.73 "GET /compute/v2.1/servers/5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32" status: 200 len: 1279 microversion: 2.1 time: 0.237785 Sep 16 09:54:28.167763 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 277/553] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:27 2022] GET /compute/v2.1/servers/5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32 => generated 1279 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:54:28.406945 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-7d3bfa81-cf4a-45b7-bf58-de97dafdfac4 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1582960382", "imageRef": "30d28050-ec9d-4227-9bb0-5247430f6177", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b92b7908-54f3-4444-8e37-e6621fa07310"}], "security_groups": [{"name": "tempest-securitygroup--382370222"}], "key_name": "tempest-keypair-1054021645", "user_data": "}} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:54:28.536084 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.network.neutron [None req-7d3bfa81-cf4a-45b7-bf58-de97dafdfac4 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] validate_networks() for [('b92b7908-54f3-4444-8e37-e6621fa07310', None, None, None, None, None)] {{(pid=127671) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 09:54:28.999933 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.virt.hardware [None req-7d3bfa81-cf4a-45b7-bf58-de97dafdfac4 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Flavor limits 0:0:0 {{(pid=127671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 09:54:29.000831 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.virt.hardware [None req-7d3bfa81-cf4a-45b7-bf58-de97dafdfac4 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Image limits 0:0:0 {{(pid=127671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 09:54:29.001452 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.virt.hardware [None req-7d3bfa81-cf4a-45b7-bf58-de97dafdfac4 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Flavor pref 0:0:0 {{(pid=127671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 09:54:29.002755 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.virt.hardware [None req-7d3bfa81-cf4a-45b7-bf58-de97dafdfac4 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Image pref 0:0:0 {{(pid=127671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 09:54:29.003173 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.virt.hardware [None req-7d3bfa81-cf4a-45b7-bf58-de97dafdfac4 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 09:54:29.014107 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7d3bfa81-cf4a-45b7-bf58-de97dafdfac4 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:29.015347 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7d3bfa81-cf4a-45b7-bf58-de97dafdfac4 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:29.019369 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7d3bfa81-cf4a-45b7-bf58-de97dafdfac4 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:29.019369 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7d3bfa81-cf4a-45b7-bf58-de97dafdfac4 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:29.019369 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7d3bfa81-cf4a-45b7-bf58-de97dafdfac4 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:29.019369 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7d3bfa81-cf4a-45b7-bf58-de97dafdfac4 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:29.054622 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.quota [None req-7d3bfa81-cf4a-45b7-bf58-de97dafdfac4 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Getting quotas for project 75007587f92646f686881c2e1bfb7b2d. Resources: {'instances', 'cores', 'ram'} {{(pid=127671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 09:54:29.062064 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.quota [None req-7d3bfa81-cf4a-45b7-bf58-de97dafdfac4 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Getting quotas for user 7dca5726e89343828e25def6e6c274bb and project 75007587f92646f686881c2e1bfb7b2d. Resources: {'instances', 'cores', 'ram'} {{(pid=127671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 09:54:29.081325 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-7d3bfa81-cf4a-45b7-bf58-de97dafdfac4 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Going to run 1 instances... {{(pid=127671) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 09:54:29.084750 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-7d3bfa81-cf4a-45b7-bf58-de97dafdfac4 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: db7a1d44-25f8-48e4-a8b6-f6ea14a508cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='30d28050-ec9d-4227-9bb0-5247430f6177',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 09:54:29.193887 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d2c500ea-4b6d-476d-ba1e-a881de43a321 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:29.194523 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-d2c500ea-4b6d-476d-ba1e-a881de43a321 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] [instance: 5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:29.216154 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d2c500ea-4b6d-476d-ba1e-a881de43a321 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:29.219814 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d2c500ea-4b6d-476d-ba1e-a881de43a321 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:29.220304 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d2c500ea-4b6d-476d-ba1e-a881de43a321 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:29.226894 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d2c500ea-4b6d-476d-ba1e-a881de43a321 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:29.227514 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d2c500ea-4b6d-476d-ba1e-a881de43a321 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:29.227970 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d2c500ea-4b6d-476d-ba1e-a881de43a321 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:29.244319 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-7d3bfa81-cf4a-45b7-bf58-de97dafdfac4 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.841670 Sep 16 09:54:29.246211 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 277/554] 10.222.0.73 () {60 vars in 1147 bytes} [Fri Sep 16 09:54:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 844 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 09:54:29.259693 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-b3c6c34b-58cd-4543-90ea-74c1da7b7d6c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:29.260659 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-b3c6c34b-58cd-4543-90ea-74c1da7b7d6c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: db7a1d44-25f8-48e4-a8b6-f6ea14a508cb] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:29.356890 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-b3c6c34b-58cd-4543-90ea-74c1da7b7d6c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:29.373193 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-b3c6c34b-58cd-4543-90ea-74c1da7b7d6c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb" status: 200 len: 1242 microversion: 2.1 time: 0.117596 Sep 16 09:54:29.373751 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 278/555] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:29 2022] GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb => generated 1242 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:54:29.571218 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-d2c500ea-4b6d-476d-ba1e-a881de43a321 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1142f8595de54bfc8f28a5152eaa00d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d2a4f111114064aa5a477177e6d1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:29.581569 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-d2c500ea-4b6d-476d-ba1e-a881de43a321 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] 10.222.0.73 "GET /compute/v2.1/servers/5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32" status: 200 len: 1319 microversion: 2.1 time: 0.389935 Sep 16 09:54:29.582168 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 278/556] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:29 2022] GET /compute/v2.1/servers/5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32 => generated 1319 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:54:30.403094 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-b8e0d244-adc2-4b01-a850-365d21d1c45d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:30.404321 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-b8e0d244-adc2-4b01-a850-365d21d1c45d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: db7a1d44-25f8-48e4-a8b6-f6ea14a508cb] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:30.414904 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b8e0d244-adc2-4b01-a850-365d21d1c45d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:30.415799 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b8e0d244-adc2-4b01-a850-365d21d1c45d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:30.416561 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b8e0d244-adc2-4b01-a850-365d21d1c45d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:30.417754 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b8e0d244-adc2-4b01-a850-365d21d1c45d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:30.418502 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b8e0d244-adc2-4b01-a850-365d21d1c45d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:30.419200 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b8e0d244-adc2-4b01-a850-365d21d1c45d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:30.495704 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-b8e0d244-adc2-4b01-a850-365d21d1c45d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:30.505408 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-b8e0d244-adc2-4b01-a850-365d21d1c45d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb" status: 200 len: 1246 microversion: 2.1 time: 0.110066 Sep 16 09:54:30.509215 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 279/557] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:30 2022] GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb => generated 1246 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:54:30.547564 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-9a192921-e45a-4533-8f80-e6e3312183d1 req-388833b1-67c2-4f3e-9680-747f81235f41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32", "tag": "653f531b-38b0-487f-a8d5-e1b3745ae870"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:54:30.561020 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-9a192921-e45a-4533-8f80-e6e3312183d1 req-388833b1-67c2-4f3e-9680-747f81235f41 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:30.561949 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-9a192921-e45a-4533-8f80-e6e3312183d1 req-388833b1-67c2-4f3e-9680-747f81235f41 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:30.562772 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-9a192921-e45a-4533-8f80-e6e3312183d1 req-388833b1-67c2-4f3e-9680-747f81235f41 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:30.587661 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-9a192921-e45a-4533-8f80-e6e3312183d1 req-388833b1-67c2-4f3e-9680-747f81235f41 service nova] Creating event network-changed:653f531b-38b0-487f-a8d5-e1b3745ae870 for instance 5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32 on hv-cinder-79053 Sep 16 09:54:30.593313 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-9a192921-e45a-4533-8f80-e6e3312183d1 req-388833b1-67c2-4f3e-9680-747f81235f41 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049959 Sep 16 09:54:30.594358 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 279/558] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:54:30.617402 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-e1e62389-b752-40aa-8b4d-3d453a8319fb tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:30.618276 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-e1e62389-b752-40aa-8b4d-3d453a8319fb tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] [instance: 5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:30.626066 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e1e62389-b752-40aa-8b4d-3d453a8319fb tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:30.628682 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e1e62389-b752-40aa-8b4d-3d453a8319fb tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:30.628682 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e1e62389-b752-40aa-8b4d-3d453a8319fb tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:30.628682 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e1e62389-b752-40aa-8b4d-3d453a8319fb tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:30.628682 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e1e62389-b752-40aa-8b4d-3d453a8319fb tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:30.629085 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e1e62389-b752-40aa-8b4d-3d453a8319fb tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:30.700021 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-e5a227a8-7f0c-4c32-904c-3750cd65420f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ac2bcb1-a7b1-4e12-9c85-de588838b70e"}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:54:30.702637 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-e5a227a8-7f0c-4c32-904c-3750cd65420f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:30.728351 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e5a227a8-7f0c-4c32-904c-3750cd65420f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:30.729102 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e5a227a8-7f0c-4c32-904c-3750cd65420f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:30.729966 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e5a227a8-7f0c-4c32-904c-3750cd65420f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:30.730720 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e5a227a8-7f0c-4c32-904c-3750cd65420f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:30.731333 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e5a227a8-7f0c-4c32-904c-3750cd65420f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:30.732140 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e5a227a8-7f0c-4c32-904c-3750cd65420f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:30.886168 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-e1e62389-b752-40aa-8b4d-3d453a8319fb tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1142f8595de54bfc8f28a5152eaa00d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d2a4f111114064aa5a477177e6d1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:30.897328 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-e1e62389-b752-40aa-8b4d-3d453a8319fb tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] 10.222.0.73 "GET /compute/v2.1/servers/5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32" status: 200 len: 1319 microversion: 2.1 time: 0.290847 Sep 16 09:54:30.897577 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 280/559] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:30 2022] GET /compute/v2.1/servers/5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32 => generated 1319 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:54:31.532714 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-7d0ce21d-5f00-455d-b60f-f7aa169f9bd1 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:31.533992 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-7d0ce21d-5f00-455d-b60f-f7aa169f9bd1 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: db7a1d44-25f8-48e4-a8b6-f6ea14a508cb] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:31.543486 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7d0ce21d-5f00-455d-b60f-f7aa169f9bd1 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:31.544340 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7d0ce21d-5f00-455d-b60f-f7aa169f9bd1 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:31.544930 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7d0ce21d-5f00-455d-b60f-f7aa169f9bd1 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:31.545834 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7d0ce21d-5f00-455d-b60f-f7aa169f9bd1 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:31.547127 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7d0ce21d-5f00-455d-b60f-f7aa169f9bd1 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:31.547707 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7d0ce21d-5f00-455d-b60f-f7aa169f9bd1 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:31.626453 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-7d0ce21d-5f00-455d-b60f-f7aa169f9bd1 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:31.634371 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-7d0ce21d-5f00-455d-b60f-f7aa169f9bd1 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb" status: 200 len: 1294 microversion: 2.1 time: 0.109432 Sep 16 09:54:31.634960 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 281/560] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:31 2022] GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb => generated 1294 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:54:31.740226 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-e5a227a8-7f0c-4c32-904c-3750cd65420f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "POST /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.044520 Sep 16 09:54:31.746913 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 280/561] 10.222.0.73 () {60 vars in 1323 bytes} [Fri Sep 16 09:54:30 2022] POST /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa/os-volume_attachments => generated 194 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 09:54:31.921256 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-d173572f-8a54-4672-96ee-9509e9a949c7 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:31.922087 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-d173572f-8a54-4672-96ee-9509e9a949c7 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] [instance: 5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:31.943571 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d173572f-8a54-4672-96ee-9509e9a949c7 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:31.944263 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d173572f-8a54-4672-96ee-9509e9a949c7 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:31.944996 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d173572f-8a54-4672-96ee-9509e9a949c7 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:31.946048 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d173572f-8a54-4672-96ee-9509e9a949c7 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:31.946808 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d173572f-8a54-4672-96ee-9509e9a949c7 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:31.947346 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d173572f-8a54-4672-96ee-9509e9a949c7 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:32.101122 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-d173572f-8a54-4672-96ee-9509e9a949c7 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1142f8595de54bfc8f28a5152eaa00d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d2a4f111114064aa5a477177e6d1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:32.114065 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-d173572f-8a54-4672-96ee-9509e9a949c7 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] 10.222.0.73 "GET /compute/v2.1/servers/5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32" status: 200 len: 1319 microversion: 2.1 time: 0.196863 Sep 16 09:54:32.115132 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 282/562] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:31 2022] GET /compute/v2.1/servers/5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32 => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:54:32.659562 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-6a1d1d6e-7176-447d-b26f-713836b5af74 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:32.660286 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-6a1d1d6e-7176-447d-b26f-713836b5af74 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: db7a1d44-25f8-48e4-a8b6-f6ea14a508cb] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:32.666919 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6a1d1d6e-7176-447d-b26f-713836b5af74 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:32.667665 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6a1d1d6e-7176-447d-b26f-713836b5af74 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:32.668163 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6a1d1d6e-7176-447d-b26f-713836b5af74 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:32.668928 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6a1d1d6e-7176-447d-b26f-713836b5af74 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:32.669453 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6a1d1d6e-7176-447d-b26f-713836b5af74 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:32.669978 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6a1d1d6e-7176-447d-b26f-713836b5af74 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:32.745311 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-6a1d1d6e-7176-447d-b26f-713836b5af74 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:32.756506 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-6a1d1d6e-7176-447d-b26f-713836b5af74 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb" status: 200 len: 1302 microversion: 2.1 time: 0.101885 Sep 16 09:54:32.757201 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 281/563] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:32 2022] GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb => generated 1302 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:54:33.151673 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-e6f2518c-ad48-40bb-9bcb-5178d1445c76 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:33.152999 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-e6f2518c-ad48-40bb-9bcb-5178d1445c76 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] [instance: 5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:33.166604 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e6f2518c-ad48-40bb-9bcb-5178d1445c76 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:33.168309 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e6f2518c-ad48-40bb-9bcb-5178d1445c76 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:33.169264 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e6f2518c-ad48-40bb-9bcb-5178d1445c76 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:33.170260 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e6f2518c-ad48-40bb-9bcb-5178d1445c76 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:33.170969 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e6f2518c-ad48-40bb-9bcb-5178d1445c76 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:33.171757 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e6f2518c-ad48-40bb-9bcb-5178d1445c76 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:33.330107 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-e6f2518c-ad48-40bb-9bcb-5178d1445c76 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1142f8595de54bfc8f28a5152eaa00d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d2a4f111114064aa5a477177e6d1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:33.339175 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-e6f2518c-ad48-40bb-9bcb-5178d1445c76 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] 10.222.0.73 "GET /compute/v2.1/servers/5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32" status: 200 len: 1319 microversion: 2.1 time: 0.197278 Sep 16 09:54:33.340267 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 283/564] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:33 2022] GET /compute/v2.1/servers/5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32 => generated 1319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:54:33.784606 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-92553b77-c94a-45aa-8198-8a14b5bbc993 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:33.786609 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-92553b77-c94a-45aa-8198-8a14b5bbc993 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: db7a1d44-25f8-48e4-a8b6-f6ea14a508cb] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:33.795897 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-92553b77-c94a-45aa-8198-8a14b5bbc993 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:33.797117 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-92553b77-c94a-45aa-8198-8a14b5bbc993 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:33.797727 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-92553b77-c94a-45aa-8198-8a14b5bbc993 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:33.799962 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-92553b77-c94a-45aa-8198-8a14b5bbc993 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:33.800678 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-92553b77-c94a-45aa-8198-8a14b5bbc993 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:33.801247 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-92553b77-c94a-45aa-8198-8a14b5bbc993 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:34.100963 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-92553b77-c94a-45aa-8198-8a14b5bbc993 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:34.116554 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-92553b77-c94a-45aa-8198-8a14b5bbc993 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb" status: 200 len: 1367 microversion: 2.1 time: 0.338686 Sep 16 09:54:34.118354 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 282/565] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:33 2022] GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb => generated 1367 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:54:34.371685 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-15759624-1633-4773-aa9b-5054cd105523 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:34.372298 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-15759624-1633-4773-aa9b-5054cd105523 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] [instance: 5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:34.380536 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-15759624-1633-4773-aa9b-5054cd105523 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:34.381306 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-15759624-1633-4773-aa9b-5054cd105523 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:34.381954 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-15759624-1633-4773-aa9b-5054cd105523 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:34.382923 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-15759624-1633-4773-aa9b-5054cd105523 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:34.383570 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-15759624-1633-4773-aa9b-5054cd105523 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:34.384193 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-15759624-1633-4773-aa9b-5054cd105523 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:34.527132 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-15759624-1633-4773-aa9b-5054cd105523 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1142f8595de54bfc8f28a5152eaa00d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d2a4f111114064aa5a477177e6d1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:34.536136 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-15759624-1633-4773-aa9b-5054cd105523 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] 10.222.0.73 "GET /compute/v2.1/servers/5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32" status: 200 len: 1319 microversion: 2.1 time: 0.168244 Sep 16 09:54:34.537154 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 284/566] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:34 2022] GET /compute/v2.1/servers/5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:54:35.118871 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-9a1ce23b-85d0-4ea7-955e-1ec2cb8d0136 req-d66e0d40-f41f-4872-8a1b-0f5339680be3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db7a1d44-25f8-48e4-a8b6-f6ea14a508cb", "tag": "8eda7ab4-bb91-4e39-a83a-f6278b385656"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:54:35.137077 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-9a1ce23b-85d0-4ea7-955e-1ec2cb8d0136 req-d66e0d40-f41f-4872-8a1b-0f5339680be3 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:35.141160 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-9a1ce23b-85d0-4ea7-955e-1ec2cb8d0136 req-d66e0d40-f41f-4872-8a1b-0f5339680be3 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:35.142063 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-9a1ce23b-85d0-4ea7-955e-1ec2cb8d0136 req-d66e0d40-f41f-4872-8a1b-0f5339680be3 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:35.147164 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-05c624c6-185c-4b23-a0bf-f27d8ccebc70 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:35.147872 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-05c624c6-185c-4b23-a0bf-f27d8ccebc70 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: db7a1d44-25f8-48e4-a8b6-f6ea14a508cb] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:35.159451 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-9a1ce23b-85d0-4ea7-955e-1ec2cb8d0136 req-d66e0d40-f41f-4872-8a1b-0f5339680be3 service nova] Creating event network-changed:8eda7ab4-bb91-4e39-a83a-f6278b385656 for instance db7a1d44-25f8-48e4-a8b6-f6ea14a508cb on hv-cinder-79053 Sep 16 09:54:35.165329 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-9a1ce23b-85d0-4ea7-955e-1ec2cb8d0136 req-d66e0d40-f41f-4872-8a1b-0f5339680be3 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050020 Sep 16 09:54:35.166989 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 283/567] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:54:35.168897 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-05c624c6-185c-4b23-a0bf-f27d8ccebc70 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:35.169720 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-05c624c6-185c-4b23-a0bf-f27d8ccebc70 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:35.170274 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-05c624c6-185c-4b23-a0bf-f27d8ccebc70 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:35.171074 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-05c624c6-185c-4b23-a0bf-f27d8ccebc70 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:35.172581 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-05c624c6-185c-4b23-a0bf-f27d8ccebc70 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:35.173216 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-05c624c6-185c-4b23-a0bf-f27d8ccebc70 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:35.351943 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-05c624c6-185c-4b23-a0bf-f27d8ccebc70 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:35.362258 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-05c624c6-185c-4b23-a0bf-f27d8ccebc70 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb" status: 200 len: 1367 microversion: 2.1 time: 0.219092 Sep 16 09:54:35.363071 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 285/568] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:35 2022] GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:54:35.566791 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-17152751-9c80-471d-b3e0-a449404376bb tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:35.568347 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-17152751-9c80-471d-b3e0-a449404376bb tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] [instance: 5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:35.578196 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-17152751-9c80-471d-b3e0-a449404376bb tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:35.579227 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-17152751-9c80-471d-b3e0-a449404376bb tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:35.581114 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-17152751-9c80-471d-b3e0-a449404376bb tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:35.582133 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-17152751-9c80-471d-b3e0-a449404376bb tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:35.582993 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-17152751-9c80-471d-b3e0-a449404376bb tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:35.583637 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-17152751-9c80-471d-b3e0-a449404376bb tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:35.660246 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell0:SELECT=4 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:54:35.817884 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-17152751-9c80-471d-b3e0-a449404376bb tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1142f8595de54bfc8f28a5152eaa00d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d2a4f111114064aa5a477177e6d1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:35.828577 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-17152751-9c80-471d-b3e0-a449404376bb tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] 10.222.0.73 "GET /compute/v2.1/servers/5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32" status: 200 len: 1319 microversion: 2.1 time: 0.269446 Sep 16 09:54:35.829357 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 284/569] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:35 2022] GET /compute/v2.1/servers/5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32 => generated 1319 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:54:36.386881 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-ef84424e-02eb-49f3-9cfc-804cc2d63329 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:36.387501 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-ef84424e-02eb-49f3-9cfc-804cc2d63329 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: db7a1d44-25f8-48e4-a8b6-f6ea14a508cb] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:36.394637 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ef84424e-02eb-49f3-9cfc-804cc2d63329 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:36.395129 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ef84424e-02eb-49f3-9cfc-804cc2d63329 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:36.395572 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ef84424e-02eb-49f3-9cfc-804cc2d63329 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:36.396270 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ef84424e-02eb-49f3-9cfc-804cc2d63329 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:36.396732 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ef84424e-02eb-49f3-9cfc-804cc2d63329 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:36.397165 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ef84424e-02eb-49f3-9cfc-804cc2d63329 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:36.529817 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-ef84424e-02eb-49f3-9cfc-804cc2d63329 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:36.538197 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-ef84424e-02eb-49f3-9cfc-804cc2d63329 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb" status: 200 len: 1367 microversion: 2.1 time: 0.155218 Sep 16 09:54:36.538761 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 286/570] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:36 2022] GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:54:36.852370 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-40c382d2-89fd-4d80-8d5a-d9f877423512 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:36.853021 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-40c382d2-89fd-4d80-8d5a-d9f877423512 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] [instance: 5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:36.859634 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-40c382d2-89fd-4d80-8d5a-d9f877423512 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:36.860127 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-40c382d2-89fd-4d80-8d5a-d9f877423512 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:36.860567 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-40c382d2-89fd-4d80-8d5a-d9f877423512 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:36.862461 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-40c382d2-89fd-4d80-8d5a-d9f877423512 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:36.862929 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-40c382d2-89fd-4d80-8d5a-d9f877423512 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:36.863359 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-40c382d2-89fd-4d80-8d5a-d9f877423512 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:36.994139 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-40c382d2-89fd-4d80-8d5a-d9f877423512 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1142f8595de54bfc8f28a5152eaa00d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d2a4f111114064aa5a477177e6d1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:37.002421 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-40c382d2-89fd-4d80-8d5a-d9f877423512 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] 10.222.0.73 "GET /compute/v2.1/servers/5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32" status: 200 len: 1319 microversion: 2.1 time: 0.153301 Sep 16 09:54:37.003006 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 285/571] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:36 2022] GET /compute/v2.1/servers/5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:54:37.549806 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [req-39066df4-50ec-4ab2-af7c-7283185ea620 req-8ae42825-0373-4541-b6ec-b090fd410f23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32", "name": "network-vif-plugged", "status": "completed", "tag": "653f531b-38b0-487f-a8d5-e1b3745ae870"}]} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:54:37.563456 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-027d7c3b-b009-40d7-86d4-0d421772d86d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:37.563598 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-39066df4-50ec-4ab2-af7c-7283185ea620 req-8ae42825-0373-4541-b6ec-b090fd410f23 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:37.563690 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-027d7c3b-b009-40d7-86d4-0d421772d86d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: db7a1d44-25f8-48e4-a8b6-f6ea14a508cb] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:37.563770 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-39066df4-50ec-4ab2-af7c-7283185ea620 req-8ae42825-0373-4541-b6ec-b090fd410f23 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:37.565011 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-39066df4-50ec-4ab2-af7c-7283185ea620 req-8ae42825-0373-4541-b6ec-b090fd410f23 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:37.569369 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-027d7c3b-b009-40d7-86d4-0d421772d86d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:37.570132 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-027d7c3b-b009-40d7-86d4-0d421772d86d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:37.570568 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-027d7c3b-b009-40d7-86d4-0d421772d86d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:37.571269 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-027d7c3b-b009-40d7-86d4-0d421772d86d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:37.571735 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-027d7c3b-b009-40d7-86d4-0d421772d86d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:37.572154 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-027d7c3b-b009-40d7-86d4-0d421772d86d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:37.577445 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.compute.server_external_events [req-39066df4-50ec-4ab2-af7c-7283185ea620 req-8ae42825-0373-4541-b6ec-b090fd410f23 service nova] Creating event network-vif-plugged:653f531b-38b0-487f-a8d5-e1b3745ae870 for instance 5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32 on hv-cinder-79053 Sep 16 09:54:37.583534 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [req-39066df4-50ec-4ab2-af7c-7283185ea620 req-8ae42825-0373-4541-b6ec-b090fd410f23 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042668 Sep 16 09:54:37.584333 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 287/572] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:54:37.802689 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-027d7c3b-b009-40d7-86d4-0d421772d86d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:37.810565 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-027d7c3b-b009-40d7-86d4-0d421772d86d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb" status: 200 len: 1367 microversion: 2.1 time: 0.252679 Sep 16 09:54:37.811147 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 286/573] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:37 2022] GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb => generated 1367 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:54:38.025898 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-c906c6c5-f244-49e8-88d8-2ba2e4f10e7f tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:38.026592 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-c906c6c5-f244-49e8-88d8-2ba2e4f10e7f tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] [instance: 5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:38.033334 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c906c6c5-f244-49e8-88d8-2ba2e4f10e7f tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:38.033839 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c906c6c5-f244-49e8-88d8-2ba2e4f10e7f tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:38.034271 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c906c6c5-f244-49e8-88d8-2ba2e4f10e7f tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:38.034981 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c906c6c5-f244-49e8-88d8-2ba2e4f10e7f tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:38.035416 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c906c6c5-f244-49e8-88d8-2ba2e4f10e7f tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:38.035961 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c906c6c5-f244-49e8-88d8-2ba2e4f10e7f tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:38.040206 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell1:SELECT=100 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:54:38.169356 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-c906c6c5-f244-49e8-88d8-2ba2e4f10e7f tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1142f8595de54bfc8f28a5152eaa00d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d2a4f111114064aa5a477177e6d1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:38.178469 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-c906c6c5-f244-49e8-88d8-2ba2e4f10e7f tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] 10.222.0.73 "GET /compute/v2.1/servers/5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32" status: 200 len: 1319 microversion: 2.1 time: 0.156993 Sep 16 09:54:38.179037 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 288/574] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:38 2022] GET /compute/v2.1/servers/5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:54:38.834457 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-177cbff8-3f65-41aa-abd2-fb145e3badac tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:38.835082 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-177cbff8-3f65-41aa-abd2-fb145e3badac tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: db7a1d44-25f8-48e4-a8b6-f6ea14a508cb] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:38.841403 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-177cbff8-3f65-41aa-abd2-fb145e3badac tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:38.841922 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-177cbff8-3f65-41aa-abd2-fb145e3badac tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:38.842356 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-177cbff8-3f65-41aa-abd2-fb145e3badac tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:38.843038 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-177cbff8-3f65-41aa-abd2-fb145e3badac tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:38.843489 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-177cbff8-3f65-41aa-abd2-fb145e3badac tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:38.843906 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-177cbff8-3f65-41aa-abd2-fb145e3badac tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:38.982586 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-177cbff8-3f65-41aa-abd2-fb145e3badac tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:38.991421 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-177cbff8-3f65-41aa-abd2-fb145e3badac tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb" status: 200 len: 1367 microversion: 2.1 time: 0.161420 Sep 16 09:54:38.992196 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 287/575] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:38 2022] GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:54:39.202052 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-704de481-d041-458d-8f43-2ea5706ad30e tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:39.202670 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-704de481-d041-458d-8f43-2ea5706ad30e tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] [instance: 5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:39.205028 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell0:SELECT=4 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:54:39.210660 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-704de481-d041-458d-8f43-2ea5706ad30e tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:39.213373 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-704de481-d041-458d-8f43-2ea5706ad30e tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:39.213373 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-704de481-d041-458d-8f43-2ea5706ad30e tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:39.213373 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-704de481-d041-458d-8f43-2ea5706ad30e tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:39.213373 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-704de481-d041-458d-8f43-2ea5706ad30e tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:39.213770 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-704de481-d041-458d-8f43-2ea5706ad30e tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:39.361747 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell0:SELECT=18 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:54:39.380364 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-704de481-d041-458d-8f43-2ea5706ad30e tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1142f8595de54bfc8f28a5152eaa00d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d2a4f111114064aa5a477177e6d1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:39.390611 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-704de481-d041-458d-8f43-2ea5706ad30e tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] 10.222.0.73 "GET /compute/v2.1/servers/5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32" status: 200 len: 1319 microversion: 2.1 time: 0.192125 Sep 16 09:54:39.405567 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 289/576] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:39 2022] GET /compute/v2.1/servers/5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32 => generated 1319 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:54:40.016680 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-96666bd2-3e59-4b79-9f5d-b8fb409dda28 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:40.018209 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-96666bd2-3e59-4b79-9f5d-b8fb409dda28 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: db7a1d44-25f8-48e4-a8b6-f6ea14a508cb] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:40.025104 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-96666bd2-3e59-4b79-9f5d-b8fb409dda28 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:40.025706 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-96666bd2-3e59-4b79-9f5d-b8fb409dda28 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:40.026119 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-96666bd2-3e59-4b79-9f5d-b8fb409dda28 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:40.026834 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-96666bd2-3e59-4b79-9f5d-b8fb409dda28 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:40.027300 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-96666bd2-3e59-4b79-9f5d-b8fb409dda28 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:40.027758 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-96666bd2-3e59-4b79-9f5d-b8fb409dda28 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:40.159772 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-96666bd2-3e59-4b79-9f5d-b8fb409dda28 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:40.167471 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-96666bd2-3e59-4b79-9f5d-b8fb409dda28 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb" status: 200 len: 1367 microversion: 2.1 time: 0.155199 Sep 16 09:54:40.168026 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 288/577] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:40 2022] GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:54:40.417527 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-ebd994fd-18b9-4052-8b5b-555c2884ec92 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:40.418169 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-ebd994fd-18b9-4052-8b5b-555c2884ec92 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] [instance: 5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:40.425863 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ebd994fd-18b9-4052-8b5b-555c2884ec92 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:40.426359 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ebd994fd-18b9-4052-8b5b-555c2884ec92 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:40.426799 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ebd994fd-18b9-4052-8b5b-555c2884ec92 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:40.427572 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ebd994fd-18b9-4052-8b5b-555c2884ec92 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:40.428025 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ebd994fd-18b9-4052-8b5b-555c2884ec92 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:40.428452 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ebd994fd-18b9-4052-8b5b-555c2884ec92 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:40.573980 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-ebd994fd-18b9-4052-8b5b-555c2884ec92 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1142f8595de54bfc8f28a5152eaa00d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d2a4f111114064aa5a477177e6d1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:40.582393 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-ebd994fd-18b9-4052-8b5b-555c2884ec92 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] 10.222.0.73 "GET /compute/v2.1/servers/5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32" status: 200 len: 1507 microversion: 2.1 time: 0.169037 Sep 16 09:54:40.582973 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 290/578] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:40 2022] GET /compute/v2.1/servers/5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32 => generated 1507 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:54:41.191896 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-dcf1a4aa-a5a5-4187-ae27-7f646f0b1fbc tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:41.192456 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-dcf1a4aa-a5a5-4187-ae27-7f646f0b1fbc tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: db7a1d44-25f8-48e4-a8b6-f6ea14a508cb] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:41.198892 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dcf1a4aa-a5a5-4187-ae27-7f646f0b1fbc tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:41.199375 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dcf1a4aa-a5a5-4187-ae27-7f646f0b1fbc tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:41.199815 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dcf1a4aa-a5a5-4187-ae27-7f646f0b1fbc tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:41.200506 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dcf1a4aa-a5a5-4187-ae27-7f646f0b1fbc tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:41.200968 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dcf1a4aa-a5a5-4187-ae27-7f646f0b1fbc tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:41.201394 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dcf1a4aa-a5a5-4187-ae27-7f646f0b1fbc tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:41.356282 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-dcf1a4aa-a5a5-4187-ae27-7f646f0b1fbc tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:41.369944 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-dcf1a4aa-a5a5-4187-ae27-7f646f0b1fbc tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb" status: 200 len: 1367 microversion: 2.1 time: 0.178129 Sep 16 09:54:41.369944 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 289/579] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:41 2022] GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:54:41.542846 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [req-179f26c3-521a-4a8e-92a1-93c266b0ae14 req-abcc42e6-31ec-4750-971a-34db157f97c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db7a1d44-25f8-48e4-a8b6-f6ea14a508cb", "name": "network-vif-plugged", "status": "completed", "tag": "8eda7ab4-bb91-4e39-a83a-f6278b385656"}]} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:54:41.555531 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-179f26c3-521a-4a8e-92a1-93c266b0ae14 req-abcc42e6-31ec-4750-971a-34db157f97c2 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:41.556676 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-179f26c3-521a-4a8e-92a1-93c266b0ae14 req-abcc42e6-31ec-4750-971a-34db157f97c2 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:41.566950 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-179f26c3-521a-4a8e-92a1-93c266b0ae14 req-abcc42e6-31ec-4750-971a-34db157f97c2 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:41.575374 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.compute.server_external_events [req-179f26c3-521a-4a8e-92a1-93c266b0ae14 req-abcc42e6-31ec-4750-971a-34db157f97c2 service nova] Creating event network-vif-plugged:8eda7ab4-bb91-4e39-a83a-f6278b385656 for instance db7a1d44-25f8-48e4-a8b6-f6ea14a508cb on hv-cinder-79053 Sep 16 09:54:41.583080 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [req-179f26c3-521a-4a8e-92a1-93c266b0ae14 req-abcc42e6-31ec-4750-971a-34db157f97c2 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043817 Sep 16 09:54:41.583811 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 291/580] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:54:41.654739 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-e74f4e27-3009-4c8e-b7f3-b58c17a96833 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:54:41.657227 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-e74f4e27-3009-4c8e-b7f3-b58c17a96833 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:41.660369 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:54:41.663936 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e74f4e27-3009-4c8e-b7f3-b58c17a96833 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:41.664295 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e74f4e27-3009-4c8e-b7f3-b58c17a96833 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:41.664730 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e74f4e27-3009-4c8e-b7f3-b58c17a96833 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:41.666005 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e74f4e27-3009-4c8e-b7f3-b58c17a96833 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:41.666471 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e74f4e27-3009-4c8e-b7f3-b58c17a96833 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:41.666900 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e74f4e27-3009-4c8e-b7f3-b58c17a96833 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:41.694600 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.objects.instance [None req-e74f4e27-3009-4c8e-b7f3-b58c17a96833 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lazy-loading 'flavor' on Instance uuid bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa {{(pid=127670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 09:54:41.984845 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:54:42.064628 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-e74f4e27-3009-4c8e-b7f3-b58c17a96833 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "POST /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa/action" status: 200 len: 32 microversion: 2.1 time: 0.413650 Sep 16 09:54:42.065636 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 290/581] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Sep 16 09:54:41 2022] POST /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa/action => generated 32 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 09:54:42.076058 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-589a3e74-0dba-419f-bbc4-e5fd34548ccc tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:42.076761 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-589a3e74-0dba-419f-bbc4-e5fd34548ccc tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:42.083974 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-589a3e74-0dba-419f-bbc4-e5fd34548ccc tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:42.084573 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-589a3e74-0dba-419f-bbc4-e5fd34548ccc tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:42.084910 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-589a3e74-0dba-419f-bbc4-e5fd34548ccc tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:42.085661 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-589a3e74-0dba-419f-bbc4-e5fd34548ccc tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:42.086124 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-589a3e74-0dba-419f-bbc4-e5fd34548ccc tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:42.086551 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-589a3e74-0dba-419f-bbc4-e5fd34548ccc tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:42.244033 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-589a3e74-0dba-419f-bbc4-e5fd34548ccc tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:42.254030 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-589a3e74-0dba-419f-bbc4-e5fd34548ccc tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa" status: 200 len: 1735 microversion: 2.1 time: 0.181555 Sep 16 09:54:42.254370 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 292/582] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:42 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa => generated 1735 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:54:42.394549 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-129bf0c6-1810-4674-bdbc-cc75ad3d0398 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:42.395359 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-129bf0c6-1810-4674-bdbc-cc75ad3d0398 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: db7a1d44-25f8-48e4-a8b6-f6ea14a508cb] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:42.403111 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-129bf0c6-1810-4674-bdbc-cc75ad3d0398 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:42.403652 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-129bf0c6-1810-4674-bdbc-cc75ad3d0398 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:42.404054 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-129bf0c6-1810-4674-bdbc-cc75ad3d0398 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:42.405360 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-129bf0c6-1810-4674-bdbc-cc75ad3d0398 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:42.405360 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-129bf0c6-1810-4674-bdbc-cc75ad3d0398 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:42.405665 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-129bf0c6-1810-4674-bdbc-cc75ad3d0398 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:42.553697 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-129bf0c6-1810-4674-bdbc-cc75ad3d0398 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:42.570565 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-129bf0c6-1810-4674-bdbc-cc75ad3d0398 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb" status: 200 len: 1367 microversion: 2.1 time: 0.181841 Sep 16 09:54:42.571529 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 291/583] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:42 2022] GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:54:43.277764 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-c1e3ac0c-034d-4a88-acb6-465f733eeff9 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:43.284478 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-c1e3ac0c-034d-4a88-acb6-465f733eeff9 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:43.290187 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c1e3ac0c-034d-4a88-acb6-465f733eeff9 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:43.291138 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c1e3ac0c-034d-4a88-acb6-465f733eeff9 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:43.291790 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c1e3ac0c-034d-4a88-acb6-465f733eeff9 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:43.292869 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c1e3ac0c-034d-4a88-acb6-465f733eeff9 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:43.293491 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c1e3ac0c-034d-4a88-acb6-465f733eeff9 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:43.294106 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c1e3ac0c-034d-4a88-acb6-465f733eeff9 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:43.465229 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-c1e3ac0c-034d-4a88-acb6-465f733eeff9 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:43.475258 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-c1e3ac0c-034d-4a88-acb6-465f733eeff9 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa" status: 200 len: 1735 microversion: 2.1 time: 0.201514 Sep 16 09:54:43.475959 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 293/584] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:43 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa => generated 1735 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:54:43.601387 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-cb64a214-89ce-4094-94b2-37271e7ee31f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:43.602104 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-cb64a214-89ce-4094-94b2-37271e7ee31f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: db7a1d44-25f8-48e4-a8b6-f6ea14a508cb] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:43.609371 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cb64a214-89ce-4094-94b2-37271e7ee31f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:43.609973 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cb64a214-89ce-4094-94b2-37271e7ee31f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:43.610562 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cb64a214-89ce-4094-94b2-37271e7ee31f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:43.611386 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cb64a214-89ce-4094-94b2-37271e7ee31f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:43.611916 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cb64a214-89ce-4094-94b2-37271e7ee31f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:43.612426 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cb64a214-89ce-4094-94b2-37271e7ee31f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:43.828522 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-cb64a214-89ce-4094-94b2-37271e7ee31f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:43.836734 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-cb64a214-89ce-4094-94b2-37271e7ee31f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb" status: 200 len: 1558 microversion: 2.1 time: 0.239731 Sep 16 09:54:43.837609 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 292/585] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:43 2022] GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb => generated 1558 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:54:43.862500 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-d1b1e7ca-3803-4b78-83cf-27515970d4ae tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:43.863488 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-d1b1e7ca-3803-4b78-83cf-27515970d4ae tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: db7a1d44-25f8-48e4-a8b6-f6ea14a508cb] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:43.870929 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d1b1e7ca-3803-4b78-83cf-27515970d4ae tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:43.871875 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d1b1e7ca-3803-4b78-83cf-27515970d4ae tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:43.873052 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d1b1e7ca-3803-4b78-83cf-27515970d4ae tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:43.873771 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d1b1e7ca-3803-4b78-83cf-27515970d4ae tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:43.874454 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d1b1e7ca-3803-4b78-83cf-27515970d4ae tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:43.875116 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d1b1e7ca-3803-4b78-83cf-27515970d4ae tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:43.968144 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-d1b1e7ca-3803-4b78-83cf-27515970d4ae tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.112092 Sep 16 09:54:43.968732 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 294/586] 10.222.0.73 () {58 vars in 1275 bytes} [Fri Sep 16 09:54:43 2022] GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb/os-interface => generated 285 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 09:54:44.500904 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-af075e9c-8d63-4652-9e93-ccece7a2f827 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:44.502625 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-af075e9c-8d63-4652-9e93-ccece7a2f827 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:44.508975 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-af075e9c-8d63-4652-9e93-ccece7a2f827 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:44.509587 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-af075e9c-8d63-4652-9e93-ccece7a2f827 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:44.510074 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-af075e9c-8d63-4652-9e93-ccece7a2f827 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:44.510844 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-af075e9c-8d63-4652-9e93-ccece7a2f827 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:44.512614 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-af075e9c-8d63-4652-9e93-ccece7a2f827 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:44.513125 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-af075e9c-8d63-4652-9e93-ccece7a2f827 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:44.723890 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-af075e9c-8d63-4652-9e93-ccece7a2f827 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:44.733327 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-af075e9c-8d63-4652-9e93-ccece7a2f827 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa" status: 200 len: 1735 microversion: 2.1 time: 0.236705 Sep 16 09:54:44.734333 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 293/587] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:44 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa => generated 1735 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:54:45.420010 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [req-405c6cae-7540-41fd-84f2-a5da9addfed3 req-f8856a01-ca73-4484-aceb-52b674f89c94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db7a1d44-25f8-48e4-a8b6-f6ea14a508cb", "tag": "8eda7ab4-bb91-4e39-a83a-f6278b385656"}]} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:54:45.437474 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-405c6cae-7540-41fd-84f2-a5da9addfed3 req-f8856a01-ca73-4484-aceb-52b674f89c94 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:45.437989 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-405c6cae-7540-41fd-84f2-a5da9addfed3 req-f8856a01-ca73-4484-aceb-52b674f89c94 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:45.444415 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-405c6cae-7540-41fd-84f2-a5da9addfed3 req-f8856a01-ca73-4484-aceb-52b674f89c94 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:45.458793 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.compute.server_external_events [req-405c6cae-7540-41fd-84f2-a5da9addfed3 req-f8856a01-ca73-4484-aceb-52b674f89c94 service nova] Creating event network-changed:8eda7ab4-bb91-4e39-a83a-f6278b385656 for instance db7a1d44-25f8-48e4-a8b6-f6ea14a508cb on hv-cinder-79053 Sep 16 09:54:45.469846 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [req-405c6cae-7540-41fd-84f2-a5da9addfed3 req-f8856a01-ca73-4484-aceb-52b674f89c94 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054187 Sep 16 09:54:45.471220 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 295/588] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:54:45.758823 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d0315c99-e3d7-404e-99e5-c9e5df8aa675 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:45.759615 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-d0315c99-e3d7-404e-99e5-c9e5df8aa675 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:45.766567 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d0315c99-e3d7-404e-99e5-c9e5df8aa675 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:45.768447 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d0315c99-e3d7-404e-99e5-c9e5df8aa675 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:45.769116 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d0315c99-e3d7-404e-99e5-c9e5df8aa675 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:45.770082 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d0315c99-e3d7-404e-99e5-c9e5df8aa675 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:45.771240 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d0315c99-e3d7-404e-99e5-c9e5df8aa675 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:45.771891 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d0315c99-e3d7-404e-99e5-c9e5df8aa675 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:46.436707 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-d0315c99-e3d7-404e-99e5-c9e5df8aa675 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:46.446803 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-d0315c99-e3d7-404e-99e5-c9e5df8aa675 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa" status: 200 len: 1735 microversion: 2.1 time: 0.692427 Sep 16 09:54:46.448413 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 294/589] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:45 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa => generated 1735 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:54:47.479306 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-b72f3b9b-3736-46a2-81d2-da7ef644e641 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:47.480220 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-b72f3b9b-3736-46a2-81d2-da7ef644e641 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:47.488862 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b72f3b9b-3736-46a2-81d2-da7ef644e641 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:47.489850 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b72f3b9b-3736-46a2-81d2-da7ef644e641 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:47.490270 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b72f3b9b-3736-46a2-81d2-da7ef644e641 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:47.490987 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b72f3b9b-3736-46a2-81d2-da7ef644e641 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:47.491447 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b72f3b9b-3736-46a2-81d2-da7ef644e641 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:47.491878 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b72f3b9b-3736-46a2-81d2-da7ef644e641 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:47.659990 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-b72f3b9b-3736-46a2-81d2-da7ef644e641 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:47.668834 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-b72f3b9b-3736-46a2-81d2-da7ef644e641 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa" status: 200 len: 1735 microversion: 2.1 time: 0.194779 Sep 16 09:54:47.669418 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 296/590] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:47 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa => generated 1735 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:54:48.692378 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-3ce5ef9f-4450-4ffb-93b8-c70d498a3b5e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:48.692992 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-3ce5ef9f-4450-4ffb-93b8-c70d498a3b5e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:48.699688 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3ce5ef9f-4450-4ffb-93b8-c70d498a3b5e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:48.700174 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3ce5ef9f-4450-4ffb-93b8-c70d498a3b5e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:48.700609 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3ce5ef9f-4450-4ffb-93b8-c70d498a3b5e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:48.701306 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3ce5ef9f-4450-4ffb-93b8-c70d498a3b5e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:48.704410 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3ce5ef9f-4450-4ffb-93b8-c70d498a3b5e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:48.704410 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3ce5ef9f-4450-4ffb-93b8-c70d498a3b5e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:48.880583 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-3ce5ef9f-4450-4ffb-93b8-c70d498a3b5e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:48.901994 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-3ce5ef9f-4450-4ffb-93b8-c70d498a3b5e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa" status: 200 len: 1735 microversion: 2.1 time: 0.202684 Sep 16 09:54:48.901994 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 295/591] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:48 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa => generated 1735 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:54:49.924497 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-9126248d-d89a-4d24-b395-6b4fff44baab tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:49.926054 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-9126248d-d89a-4d24-b395-6b4fff44baab tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:49.946020 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9126248d-d89a-4d24-b395-6b4fff44baab tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:49.947226 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9126248d-d89a-4d24-b395-6b4fff44baab tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:49.948400 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9126248d-d89a-4d24-b395-6b4fff44baab tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:49.950926 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9126248d-d89a-4d24-b395-6b4fff44baab tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:49.952610 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9126248d-d89a-4d24-b395-6b4fff44baab tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:49.953707 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9126248d-d89a-4d24-b395-6b4fff44baab tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:50.148918 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-9126248d-d89a-4d24-b395-6b4fff44baab tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:50.160076 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-9126248d-d89a-4d24-b395-6b4fff44baab tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa" status: 200 len: 1735 microversion: 2.1 time: 0.246855 Sep 16 09:54:50.160665 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 297/592] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:49 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa => generated 1735 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:54:51.183542 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-669f4fd4-58b2-4357-ab21-c9937cd6f64e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:51.184767 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-669f4fd4-58b2-4357-ab21-c9937cd6f64e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:51.192517 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-669f4fd4-58b2-4357-ab21-c9937cd6f64e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:51.193012 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-669f4fd4-58b2-4357-ab21-c9937cd6f64e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:51.193453 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-669f4fd4-58b2-4357-ab21-c9937cd6f64e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:51.195111 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-669f4fd4-58b2-4357-ab21-c9937cd6f64e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:51.195740 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-669f4fd4-58b2-4357-ab21-c9937cd6f64e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:51.196335 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-669f4fd4-58b2-4357-ab21-c9937cd6f64e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:51.361343 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-669f4fd4-58b2-4357-ab21-c9937cd6f64e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:51.373389 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-669f4fd4-58b2-4357-ab21-c9937cd6f64e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa" status: 200 len: 1735 microversion: 2.1 time: 0.193412 Sep 16 09:54:51.390618 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 296/593] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:51 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa => generated 1735 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:54:52.398500 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-452ad18a-6ed0-4da9-b041-85fc76d7a61d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:52.399395 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-452ad18a-6ed0-4da9-b041-85fc76d7a61d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:52.407508 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-452ad18a-6ed0-4da9-b041-85fc76d7a61d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:52.408339 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-452ad18a-6ed0-4da9-b041-85fc76d7a61d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:52.408878 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-452ad18a-6ed0-4da9-b041-85fc76d7a61d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:52.409732 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-452ad18a-6ed0-4da9-b041-85fc76d7a61d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:52.410232 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-452ad18a-6ed0-4da9-b041-85fc76d7a61d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:52.410730 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-452ad18a-6ed0-4da9-b041-85fc76d7a61d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:52.633697 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-452ad18a-6ed0-4da9-b041-85fc76d7a61d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:52.644489 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-452ad18a-6ed0-4da9-b041-85fc76d7a61d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa" status: 200 len: 1735 microversion: 2.1 time: 0.249727 Sep 16 09:54:52.645317 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 298/594] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:52 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa => generated 1735 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:54:53.670100 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d177b0c8-d423-4f98-b18a-3326e7ff28d5 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:53.670625 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-d177b0c8-d423-4f98-b18a-3326e7ff28d5 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:53.678575 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d177b0c8-d423-4f98-b18a-3326e7ff28d5 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:53.679273 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d177b0c8-d423-4f98-b18a-3326e7ff28d5 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:53.679877 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d177b0c8-d423-4f98-b18a-3326e7ff28d5 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:53.680919 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d177b0c8-d423-4f98-b18a-3326e7ff28d5 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:53.681576 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d177b0c8-d423-4f98-b18a-3326e7ff28d5 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:53.682020 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d177b0c8-d423-4f98-b18a-3326e7ff28d5 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:53.850723 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-d177b0c8-d423-4f98-b18a-3326e7ff28d5 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:53.857225 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-d177b0c8-d423-4f98-b18a-3326e7ff28d5 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa" status: 200 len: 1735 microversion: 2.1 time: 0.191191 Sep 16 09:54:53.858069 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 297/595] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:53 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa => generated 1735 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:54:54.244618 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-66051d57-434b-4b05-9d0a-236e87c110ff tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:54.245128 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-66051d57-434b-4b05-9d0a-236e87c110ff tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:54.256493 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-66051d57-434b-4b05-9d0a-236e87c110ff tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:54.256990 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-66051d57-434b-4b05-9d0a-236e87c110ff tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:54.257532 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-66051d57-434b-4b05-9d0a-236e87c110ff tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:54.258456 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-66051d57-434b-4b05-9d0a-236e87c110ff tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:54.258790 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-66051d57-434b-4b05-9d0a-236e87c110ff tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:54.260581 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-66051d57-434b-4b05-9d0a-236e87c110ff tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:54.298286 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-66051d57-434b-4b05-9d0a-236e87c110ff tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de/os-volume_attachments/e24275f2-d690-4eaf-b3a5-e98b1eccfd54" status: 200 len: 194 microversion: 2.20 time: 0.057880 Sep 16 09:54:54.298881 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 299/596] 10.222.0.73 () {60 vars in 1454 bytes} [Fri Sep 16 09:54:54 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de/os-volume_attachments/e24275f2-d690-4eaf-b3a5-e98b1eccfd54 => generated 194 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 09:54:54.372549 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-538294a7-ef6a-4d32-912c-e32bcb633c07 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:54.373466 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-538294a7-ef6a-4d32-912c-e32bcb633c07 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:54.383558 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-538294a7-ef6a-4d32-912c-e32bcb633c07 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:54.384288 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-538294a7-ef6a-4d32-912c-e32bcb633c07 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:54.384914 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-538294a7-ef6a-4d32-912c-e32bcb633c07 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:54.385860 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-538294a7-ef6a-4d32-912c-e32bcb633c07 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:54.386847 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-538294a7-ef6a-4d32-912c-e32bcb633c07 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:54.387443 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-538294a7-ef6a-4d32-912c-e32bcb633c07 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:54.577995 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.objects.instance [None req-538294a7-ef6a-4d32-912c-e32bcb633c07 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lazy-loading 'services' on Instance uuid 88a0813e-ace7-48df-b688-533c8dbc81de {{(pid=127670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 09:54:54.880942 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-e685af50-56f3-4294-9c34-4b721864a8ef tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:54.881772 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-e685af50-56f3-4294-9c34-4b721864a8ef tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:54.888392 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e685af50-56f3-4294-9c34-4b721864a8ef tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:54.889337 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e685af50-56f3-4294-9c34-4b721864a8ef tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:54.889936 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e685af50-56f3-4294-9c34-4b721864a8ef tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:54.890737 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e685af50-56f3-4294-9c34-4b721864a8ef tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:54.891982 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e685af50-56f3-4294-9c34-4b721864a8ef tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:54.892585 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e685af50-56f3-4294-9c34-4b721864a8ef tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:54.914660 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-538294a7-ef6a-4d32-912c-e32bcb633c07 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "DELETE /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de/os-volume_attachments/e24275f2-d690-4eaf-b3a5-e98b1eccfd54" status: 202 len: 0 microversion: 2.20 time: 0.545791 Sep 16 09:54:54.923194 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 298/597] 10.222.0.73 () {60 vars in 1457 bytes} [Fri Sep 16 09:54:54 2022] DELETE /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de/os-volume_attachments/e24275f2-d690-4eaf-b3a5-e98b1eccfd54 => generated 0 bytes in 550 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 16 09:54:54.929144 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-0a91073e-0c06-43d1-8fda-03122c9888d5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:54.932204 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-0a91073e-0c06-43d1-8fda-03122c9888d5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:54.942980 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0a91073e-0c06-43d1-8fda-03122c9888d5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:54.945461 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0a91073e-0c06-43d1-8fda-03122c9888d5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:54.946149 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0a91073e-0c06-43d1-8fda-03122c9888d5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:54.948093 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0a91073e-0c06-43d1-8fda-03122c9888d5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:54.949276 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0a91073e-0c06-43d1-8fda-03122c9888d5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:54.953884 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0a91073e-0c06-43d1-8fda-03122c9888d5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:55.033591 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-0a91073e-0c06-43d1-8fda-03122c9888d5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.109146 Sep 16 09:54:55.034651 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 299/598] 10.222.0.73 () {60 vars in 1343 bytes} [Fri Sep 16 09:54:54 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 09:54:55.096464 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-e685af50-56f3-4294-9c34-4b721864a8ef tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:55.109370 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-e685af50-56f3-4294-9c34-4b721864a8ef tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa" status: 200 len: 1735 microversion: 2.1 time: 0.232258 Sep 16 09:54:55.110599 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 300/599] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:54 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa => generated 1735 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:54:56.047266 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-ccf02b08-2bcf-4151-bb94-96afc0ac3fe0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:56.051330 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-ccf02b08-2bcf-4151-bb94-96afc0ac3fe0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:56.058760 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ccf02b08-2bcf-4151-bb94-96afc0ac3fe0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:56.059493 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ccf02b08-2bcf-4151-bb94-96afc0ac3fe0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:56.060127 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ccf02b08-2bcf-4151-bb94-96afc0ac3fe0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:56.061042 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ccf02b08-2bcf-4151-bb94-96afc0ac3fe0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:56.061518 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ccf02b08-2bcf-4151-bb94-96afc0ac3fe0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:56.061973 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ccf02b08-2bcf-4151-bb94-96afc0ac3fe0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:56.110974 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-ccf02b08-2bcf-4151-bb94-96afc0ac3fe0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.067203 Sep 16 09:54:56.123928 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 300/600] 10.222.0.73 () {60 vars in 1343 bytes} [Fri Sep 16 09:54:56 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 09:54:56.139244 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-08f0285f-f18c-4ef5-aea3-ac8da92abd59 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:56.139883 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-08f0285f-f18c-4ef5-aea3-ac8da92abd59 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:56.149911 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-08f0285f-f18c-4ef5-aea3-ac8da92abd59 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:56.155933 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-08f0285f-f18c-4ef5-aea3-ac8da92abd59 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:56.159411 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-08f0285f-f18c-4ef5-aea3-ac8da92abd59 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:56.160181 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-08f0285f-f18c-4ef5-aea3-ac8da92abd59 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:56.161149 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-08f0285f-f18c-4ef5-aea3-ac8da92abd59 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:56.161636 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-08f0285f-f18c-4ef5-aea3-ac8da92abd59 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:56.363361 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-08f0285f-f18c-4ef5-aea3-ac8da92abd59 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:56.372173 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-08f0285f-f18c-4ef5-aea3-ac8da92abd59 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa" status: 200 len: 1735 microversion: 2.1 time: 0.243232 Sep 16 09:54:56.396048 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 301/601] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:56 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa => generated 1735 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:54:57.124894 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-b2db0139-e6b3-4274-bf5c-97ed76df3503 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:57.130060 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-b2db0139-e6b3-4274-bf5c-97ed76df3503 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:57.137605 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b2db0139-e6b3-4274-bf5c-97ed76df3503 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:57.138367 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b2db0139-e6b3-4274-bf5c-97ed76df3503 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:57.138959 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b2db0139-e6b3-4274-bf5c-97ed76df3503 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:57.139940 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b2db0139-e6b3-4274-bf5c-97ed76df3503 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:57.140393 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b2db0139-e6b3-4274-bf5c-97ed76df3503 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:57.140997 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b2db0139-e6b3-4274-bf5c-97ed76df3503 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:57.173701 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-b2db0139-e6b3-4274-bf5c-97ed76df3503 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052598 Sep 16 09:54:57.190649 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 301/602] 10.222.0.73 () {60 vars in 1343 bytes} [Fri Sep 16 09:54:57 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:54:57.247752 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-86d97ffb-b241-4b96-a0aa-d093c0e5431b tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:57.248245 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-86d97ffb-b241-4b96-a0aa-d093c0e5431b tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:57.255709 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-86d97ffb-b241-4b96-a0aa-d093c0e5431b tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:57.256358 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-86d97ffb-b241-4b96-a0aa-d093c0e5431b tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:57.256835 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-86d97ffb-b241-4b96-a0aa-d093c0e5431b tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:57.257603 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-86d97ffb-b241-4b96-a0aa-d093c0e5431b tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:57.258192 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-86d97ffb-b241-4b96-a0aa-d093c0e5431b tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:57.258788 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-86d97ffb-b241-4b96-a0aa-d093c0e5431b tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:57.292606 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-86d97ffb-b241-4b96-a0aa-d093c0e5431b tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Going to try to terminate instance {{(pid=127671) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 09:54:57.398752 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-9bc6a173-3cf1-4e29-9c59-e4090ea475bc tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:57.399370 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-9bc6a173-3cf1-4e29-9c59-e4090ea475bc tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:57.416331 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9bc6a173-3cf1-4e29-9c59-e4090ea475bc tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:57.416826 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9bc6a173-3cf1-4e29-9c59-e4090ea475bc tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:57.418980 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9bc6a173-3cf1-4e29-9c59-e4090ea475bc tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:57.418980 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9bc6a173-3cf1-4e29-9c59-e4090ea475bc tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:57.418980 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9bc6a173-3cf1-4e29-9c59-e4090ea475bc tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:57.418980 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9bc6a173-3cf1-4e29-9c59-e4090ea475bc tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:57.624050 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-86d97ffb-b241-4b96-a0aa-d093c0e5431b tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "DELETE /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 204 len: 0 microversion: 2.20 time: 0.380268 Sep 16 09:54:57.624643 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 302/603] 10.222.0.73 () {60 vars in 1280 bytes} [Fri Sep 16 09:54:57 2022] DELETE /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 09:54:57.625439 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-9bc6a173-3cf1-4e29-9c59-e4090ea475bc tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:57.630968 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-e717d708-b744-4553-b7e2-5f52468f353e tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3dc7ce33-cfdc-4712-bd4c-b513a1a70bfc", "device": "/dev/sdb"}} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:54:57.636214 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-9bc6a173-3cf1-4e29-9c59-e4090ea475bc tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa" status: 200 len: 1735 microversion: 2.1 time: 0.241605 Sep 16 09:54:57.636410 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-e717d708-b744-4553-b7e2-5f52468f353e tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] [instance: 5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:57.643669 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e717d708-b744-4553-b7e2-5f52468f353e tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:57.644454 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e717d708-b744-4553-b7e2-5f52468f353e tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:57.645077 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e717d708-b744-4553-b7e2-5f52468f353e tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:57.646046 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e717d708-b744-4553-b7e2-5f52468f353e tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:57.646688 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e717d708-b744-4553-b7e2-5f52468f353e tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:57.647341 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e717d708-b744-4553-b7e2-5f52468f353e tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:57.650266 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 302/604] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:57 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa => generated 1735 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:54:57.662625 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-4c8bd457-2e95-458b-a59e-9b53782f55c0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:57.665060 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-4c8bd457-2e95-458b-a59e-9b53782f55c0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:57.669882 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4c8bd457-2e95-458b-a59e-9b53782f55c0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:57.670940 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4c8bd457-2e95-458b-a59e-9b53782f55c0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:57.671470 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4c8bd457-2e95-458b-a59e-9b53782f55c0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:57.672186 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4c8bd457-2e95-458b-a59e-9b53782f55c0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:57.673631 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4c8bd457-2e95-458b-a59e-9b53782f55c0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:57.674073 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4c8bd457-2e95-458b-a59e-9b53782f55c0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:57.836801 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-4c8bd457-2e95-458b-a59e-9b53782f55c0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:57.848372 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-4c8bd457-2e95-458b-a59e-9b53782f55c0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:57.850339 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-4c8bd457-2e95-458b-a59e-9b53782f55c0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:57.851900 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-4c8bd457-2e95-458b-a59e-9b53782f55c0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1719 microversion: 2.20 time: 0.200395 Sep 16 09:54:57.852483 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 303/605] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:54:57 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1719 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:54:58.666227 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-e26d75bd-181d-4273-9e20-9d146f9e7752 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:58.666836 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-e26d75bd-181d-4273-9e20-9d146f9e7752 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:58.674010 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e26d75bd-181d-4273-9e20-9d146f9e7752 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:58.674510 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e26d75bd-181d-4273-9e20-9d146f9e7752 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:58.674952 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e26d75bd-181d-4273-9e20-9d146f9e7752 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:58.675677 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e26d75bd-181d-4273-9e20-9d146f9e7752 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:58.676129 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e26d75bd-181d-4273-9e20-9d146f9e7752 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:58.676553 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e26d75bd-181d-4273-9e20-9d146f9e7752 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:58.815527 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-e26d75bd-181d-4273-9e20-9d146f9e7752 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:58.824278 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-e26d75bd-181d-4273-9e20-9d146f9e7752 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa" status: 200 len: 1735 microversion: 2.1 time: 0.162119 Sep 16 09:54:58.824833 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 304/606] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:58 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:54:58.884220 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-99e5af29-7397-4ba7-ae79-c2454a43e62b tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:58.884877 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-99e5af29-7397-4ba7-ae79-c2454a43e62b tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:58.891563 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-99e5af29-7397-4ba7-ae79-c2454a43e62b tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:58.892902 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-99e5af29-7397-4ba7-ae79-c2454a43e62b tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:58.892902 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-99e5af29-7397-4ba7-ae79-c2454a43e62b tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:58.893425 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-99e5af29-7397-4ba7-ae79-c2454a43e62b tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:58.893916 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-99e5af29-7397-4ba7-ae79-c2454a43e62b tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:58.894353 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-99e5af29-7397-4ba7-ae79-c2454a43e62b tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:59.068665 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-99e5af29-7397-4ba7-ae79-c2454a43e62b tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:59.081695 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-99e5af29-7397-4ba7-ae79-c2454a43e62b tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:59.083277 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-99e5af29-7397-4ba7-ae79-c2454a43e62b tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:54:59.084683 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-99e5af29-7397-4ba7-ae79-c2454a43e62b tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1719 microversion: 2.20 time: 0.204793 Sep 16 09:54:59.085242 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 305/607] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:54:58 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1719 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 09:54:59.647302 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:54:59.829617 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-e717d708-b744-4553-b7e2-5f52468f353e tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] 10.222.0.73 "POST /compute/v2.1/servers/5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.202615 Sep 16 09:54:59.830578 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 303/608] 10.222.0.73 () {60 vars in 1323 bytes} [Fri Sep 16 09:54:57 2022] POST /compute/v2.1/servers/5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32/os-volume_attachments => generated 194 bytes in 2205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:54:59.848934 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-407961b9-f455-4a4a-b9d9-24e0e9f315c5 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:54:59.851005 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-407961b9-f455-4a4a-b9d9-24e0e9f315c5 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:54:59.858875 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-407961b9-f455-4a4a-b9d9-24e0e9f315c5 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:59.861708 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-407961b9-f455-4a4a-b9d9-24e0e9f315c5 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:59.867022 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-407961b9-f455-4a4a-b9d9-24e0e9f315c5 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:54:59.867022 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-407961b9-f455-4a4a-b9d9-24e0e9f315c5 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:54:59.867022 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-407961b9-f455-4a4a-b9d9-24e0e9f315c5 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:54:59.867022 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-407961b9-f455-4a4a-b9d9-24e0e9f315c5 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:00.081830 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-407961b9-f455-4a4a-b9d9-24e0e9f315c5 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:00.094874 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=98 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:55:00.094874 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-407961b9-f455-4a4a-b9d9-24e0e9f315c5 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa" status: 200 len: 1735 microversion: 2.1 time: 0.249173 Sep 16 09:55:00.095302 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 306/609] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:54:59 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa => generated 1735 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:55:00.112803 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-b5f87060-2df7-496f-a1bf-960629949b6d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:00.113915 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-b5f87060-2df7-496f-a1bf-960629949b6d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:00.116381 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:55:00.130594 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b5f87060-2df7-496f-a1bf-960629949b6d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:00.136753 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b5f87060-2df7-496f-a1bf-960629949b6d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:00.137441 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b5f87060-2df7-496f-a1bf-960629949b6d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:00.138591 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b5f87060-2df7-496f-a1bf-960629949b6d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:00.139598 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b5f87060-2df7-496f-a1bf-960629949b6d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:00.140532 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b5f87060-2df7-496f-a1bf-960629949b6d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:00.484207 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-b5f87060-2df7-496f-a1bf-960629949b6d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:00.495777 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-b5f87060-2df7-496f-a1bf-960629949b6d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:00.506020 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-b5f87060-2df7-496f-a1bf-960629949b6d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:00.509007 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-b5f87060-2df7-496f-a1bf-960629949b6d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1719 microversion: 2.20 time: 0.401842 Sep 16 09:55:00.510589 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 304/610] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:55:00 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1719 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:55:01.123312 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-3723b78f-15d3-4f33-962b-4017ddfeaada tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:01.124643 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-3723b78f-15d3-4f33-962b-4017ddfeaada tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:01.140796 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3723b78f-15d3-4f33-962b-4017ddfeaada tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:01.142469 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3723b78f-15d3-4f33-962b-4017ddfeaada tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:01.143093 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3723b78f-15d3-4f33-962b-4017ddfeaada tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:01.144027 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3723b78f-15d3-4f33-962b-4017ddfeaada tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:01.144811 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3723b78f-15d3-4f33-962b-4017ddfeaada tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:01.145427 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3723b78f-15d3-4f33-962b-4017ddfeaada tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:01.179953 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [req-42aedcb8-4796-44a6-ac8a-55585dfb22e2 req-6eafdbca-7c8c-45ba-8a91-f10873f636f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88a0813e-ace7-48df-b688-533c8dbc81de", "name": "network-vif-deleted", "tag": "55883b34-2ac0-4ba3-b4af-c5503b0d8fc9"}]} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:55:01.200657 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-42aedcb8-4796-44a6-ac8a-55585dfb22e2 req-6eafdbca-7c8c-45ba-8a91-f10873f636f3 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:01.201131 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-42aedcb8-4796-44a6-ac8a-55585dfb22e2 req-6eafdbca-7c8c-45ba-8a91-f10873f636f3 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:01.201585 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-42aedcb8-4796-44a6-ac8a-55585dfb22e2 req-6eafdbca-7c8c-45ba-8a91-f10873f636f3 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:01.232803 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.compute.server_external_events [req-42aedcb8-4796-44a6-ac8a-55585dfb22e2 req-6eafdbca-7c8c-45ba-8a91-f10873f636f3 service nova] Creating event network-vif-deleted:55883b34-2ac0-4ba3-b4af-c5503b0d8fc9 for instance 88a0813e-ace7-48df-b688-533c8dbc81de on hv-cinder-79053 Sep 16 09:55:01.261613 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [req-42aedcb8-4796-44a6-ac8a-55585dfb22e2 req-6eafdbca-7c8c-45ba-8a91-f10873f636f3 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087044 Sep 16 09:55:01.263512 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 305/611] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:55:01.402126 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-3723b78f-15d3-4f33-962b-4017ddfeaada tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:01.424384 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-3723b78f-15d3-4f33-962b-4017ddfeaada tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa" status: 200 len: 1735 microversion: 2.1 time: 0.305487 Sep 16 09:55:01.425486 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 307/612] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:01 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa => generated 1735 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:55:01.537361 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-d5d8d6f3-5474-4e18-85f7-63847ecec907 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:01.540872 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-d5d8d6f3-5474-4e18-85f7-63847ecec907 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:01.559149 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d5d8d6f3-5474-4e18-85f7-63847ecec907 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:01.559816 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d5d8d6f3-5474-4e18-85f7-63847ecec907 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:01.560506 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d5d8d6f3-5474-4e18-85f7-63847ecec907 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:01.561712 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d5d8d6f3-5474-4e18-85f7-63847ecec907 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:01.564255 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d5d8d6f3-5474-4e18-85f7-63847ecec907 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:01.565783 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d5d8d6f3-5474-4e18-85f7-63847ecec907 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:01.617219 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d5d8d6f3-5474-4e18-85f7-63847ecec907 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:01.617881 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d5d8d6f3-5474-4e18-85f7-63847ecec907 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:01.618554 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d5d8d6f3-5474-4e18-85f7-63847ecec907 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:01.619217 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.objects.instance [None req-d5d8d6f3-5474-4e18-85f7-63847ecec907 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lazy-loading 'fault' on Instance uuid 88a0813e-ace7-48df-b688-533c8dbc81de {{(pid=127671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 09:55:01.678894 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-d5d8d6f3-5474-4e18-85f7-63847ecec907 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:01.690279 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-d5d8d6f3-5474-4e18-85f7-63847ecec907 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:01.692046 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-d5d8d6f3-5474-4e18-85f7-63847ecec907 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:01.693433 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-d5d8d6f3-5474-4e18-85f7-63847ecec907 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 200 len: 1370 microversion: 2.20 time: 0.161465 Sep 16 09:55:01.712409 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 306/613] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:55:01 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 1370 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:55:02.455954 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-95daf970-f46e-45da-b4d2-f20b029cc712 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:02.456563 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-95daf970-f46e-45da-b4d2-f20b029cc712 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:02.468285 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-95daf970-f46e-45da-b4d2-f20b029cc712 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:02.468796 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-95daf970-f46e-45da-b4d2-f20b029cc712 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:02.470437 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-95daf970-f46e-45da-b4d2-f20b029cc712 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:02.471167 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-95daf970-f46e-45da-b4d2-f20b029cc712 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:02.471640 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-95daf970-f46e-45da-b4d2-f20b029cc712 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:02.472154 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-95daf970-f46e-45da-b4d2-f20b029cc712 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:02.652616 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-95daf970-f46e-45da-b4d2-f20b029cc712 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:02.666397 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-95daf970-f46e-45da-b4d2-f20b029cc712 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa" status: 200 len: 1735 microversion: 2.1 time: 0.214690 Sep 16 09:55:02.667296 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 308/614] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:02 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa => generated 1735 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:55:02.720010 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-84ce9b81-825a-47ce-b48d-2f805c0f15f5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:02.720604 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-84ce9b81-825a-47ce-b48d-2f805c0f15f5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:02.727506 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-84ce9b81-825a-47ce-b48d-2f805c0f15f5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:02.728197 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-84ce9b81-825a-47ce-b48d-2f805c0f15f5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:02.728899 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-84ce9b81-825a-47ce-b48d-2f805c0f15f5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:02.729790 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-84ce9b81-825a-47ce-b48d-2f805c0f15f5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:02.730399 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-84ce9b81-825a-47ce-b48d-2f805c0f15f5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:02.730976 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-84ce9b81-825a-47ce-b48d-2f805c0f15f5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:02.746607 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.wsgi [None req-84ce9b81-825a-47ce-b48d-2f805c0f15f5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] HTTP exception thrown: Instance 88a0813e-ace7-48df-b688-533c8dbc81de could not be found. Sep 16 09:55:02.748537 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-84ce9b81-825a-47ce-b48d-2f805c0f15f5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Request method failure captured: Sep 16 09:55:02.748537 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: request: GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de HTTP/1.1 Sep 16 09:55:02.748537 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept: application/json Sep 16 09:55:02.748537 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept-Encoding: identity Sep 16 09:55:02.748537 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Connection: close Sep 16 09:55:02.748537 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Length: 0 Sep 16 09:55:02.748537 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Type: application/json Sep 16 09:55:02.748537 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Host: 10.222.0.73 Sep 16 09:55:02.748537 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Openstack-System-Scope: None Sep 16 09:55:02.748537 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: User-Agent: python-urllib3/1.26.12 Sep 16 09:55:02.748537 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Auth-Token: gAAAAABjJEbuAhf_iy02su7H6mZZHK5Z0-ZEvaCoRUZk2uYc9XMuB19tGSi2hqksSycPPIpATdk9yC5vMP1JDiTm76CI-nTH1tXyQaObI5pB3VQDdECAxF1WLMWv8DyYGvuygryKGplX-aJg9K2GwKxt6LMHbAPrjHQXrpgprHxp709LujVSSb4 Sep 16 09:55:02.748537 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Id: None Sep 16 09:55:02.748537 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Name: None Sep 16 09:55:02.748537 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Identity-Status: Confirmed Sep 16 09:55:02.748537 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Is-Admin-Project: True Sep 16 09:55:02.748537 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Openstack-Nova-Api-Version: 2.20 Sep 16 09:55:02.748537 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Id: default Sep 16 09:55:02.748537 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Name: Default Sep 16 09:55:02.748537 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Id: f1713f13f3ff494496a8ef8e5591c1b6 Sep 16 09:55:02.748537 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-359947208 Sep 16 09:55:02.748537 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Role: reader,member Sep 16 09:55:02.748537 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Roles: reader,member Sep 16 09:55:02.756440 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f1713f13f3ff494496a8ef8e5591c1b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_f1713f13f3ff494496a8ef8e5591c1b6", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f1713f13f3ff494496a8ef8e5591c1b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/f1713f13f3ff494496a8ef8e5591c1b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 09:55:02.756440 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant: tempest-AttachVolumeShelveTestJSON-359947208 Sep 16 09:55:02.756440 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Id: f1713f13f3ff494496a8ef8e5591c1b6 Sep 16 09:55:02.756440 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-359947208 Sep 16 09:55:02.756440 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User: tempest-AttachVolumeShelveTestJSON-359947208-project Sep 16 09:55:02.756440 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Id: default Sep 16 09:55:02.756440 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Name: Default Sep 16 09:55:02.756440 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Id: bc95a607e1ef43d592a5289f80464424 Sep 16 09:55:02.756440 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Name: tempest-AttachVolumeShelveTestJSON-359947208-project Sep 16 09:55:02.756440 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: method: > Sep 16 09:55:02.756440 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: exception: Instance 88a0813e-ace7-48df-b688-533c8dbc81de could not be found. Sep 16 09:55:02.756440 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: action_args: {'id': '88a0813e-ace7-48df-b688-533c8dbc81de'} Sep 16 09:55:02.757338 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 09:55:02.757338 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:55:02.757338 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 09:55:02.757338 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 09:55:02.757338 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 09:55:02.757338 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 09:55:02.757338 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 09:55:02.757338 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 09:55:02.757338 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 09:55:02.757338 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 09:55:02.757338 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88a0813e-ace7-48df-b688-533c8dbc81de could not be found. Sep 16 09:55:02.757338 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:55:02.757338 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:55:02.757338 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:55:02.757338 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:55:02.757338 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:55:02.757338 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:55:02.757338 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 09:55:02.757338 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 09:55:02.757338 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 09:55:02.758835 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:55:02.758835 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 09:55:02.758835 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 09:55:02.758835 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 09:55:02.758835 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 09:55:02.758835 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 09:55:02.758835 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 09:55:02.758835 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88a0813e-ace7-48df-b688-533c8dbc81de could not be found. Sep 16 09:55:02.758835 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:55:02.758835 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:55:02.758835 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:55:02.758835 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:55:02.758835 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:55:02.758835 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:55:02.758835 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 09:55:02.758835 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 09:55:02.758835 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88a0813e-ace7-48df-b688-533c8dbc81de could not be found. Sep 16 09:55:02.758835 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:55:02.760574 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-84ce9b81-825a-47ce-b48d-2f805c0f15f5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Returning 404 to user: Instance 88a0813e-ace7-48df-b688-533c8dbc81de could not be found. {{(pid=127671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 09:55:02.760574 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-84ce9b81-825a-47ce-b48d-2f805c0f15f5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 404 len: 111 microversion: 2.20 time: 0.035904 Sep 16 09:55:02.760574 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 307/615] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:55:02 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 09:55:02.765336 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-c4cd4066-89f6-4e05-98b1-050c7206be10 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '.version_select at 0x7ffa6dc63280>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:02.844925 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-c4cd4066-89f6-4e05-98b1-050c7206be10 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-424244921" status: 204 len: 0 microversion: 2.20 time: 0.082770 Sep 16 09:55:02.849482 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 309/616] 10.222.0.73 () {60 vars in 1259 bytes} [Fri Sep 16 09:55:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-424244921 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 09:55:03.692278 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-ec43d7c3-c3b2-4166-8736-e1d3abc57e79 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:03.693074 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-ec43d7c3-c3b2-4166-8736-e1d3abc57e79 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:03.699880 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ec43d7c3-c3b2-4166-8736-e1d3abc57e79 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:03.700456 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ec43d7c3-c3b2-4166-8736-e1d3abc57e79 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:03.701441 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ec43d7c3-c3b2-4166-8736-e1d3abc57e79 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:03.701943 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ec43d7c3-c3b2-4166-8736-e1d3abc57e79 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:03.702589 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ec43d7c3-c3b2-4166-8736-e1d3abc57e79 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:03.703001 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ec43d7c3-c3b2-4166-8736-e1d3abc57e79 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:03.810495 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-1f653b0c-47b5-43ff-8012-e4e9f6e29e5b tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Action: 'create', calling method: .version_select at 0x7ffa714a4820>, body: {"keypair": {"name": "tempest-keypair-1742301879", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjyAlxfDPH9MbrUvo47PHWzyoUcYh+uod6yUhhu+Aoe4cfppnUnEi0IXdnqKcKsjdsIhQRT+f+CjaqHayZbbWxFhrEggomGSc39I0VWLriUSmKnBrTh9QioXC0JftO0KA=="}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:55:03.846285 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-1f653b0c-47b5-43ff-8012-e4e9f6e29e5b tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Getting quotas for project f1713f13f3ff494496a8ef8e5591c1b6. Resources: {'key_pairs'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 09:55:03.856151 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-1f653b0c-47b5-43ff-8012-e4e9f6e29e5b tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Getting quotas for user bc95a607e1ef43d592a5289f80464424 and project f1713f13f3ff494496a8ef8e5591c1b6. Resources: {'key_pairs'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 09:55:03.885859 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-ec43d7c3-c3b2-4166-8736-e1d3abc57e79 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:03.897711 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-ec43d7c3-c3b2-4166-8736-e1d3abc57e79 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa" status: 200 len: 1735 microversion: 2.1 time: 0.209609 Sep 16 09:55:03.898534 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 308/617] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:03 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa => generated 1735 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:55:03.954185 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-1f653b0c-47b5-43ff-8012-e4e9f6e29e5b tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.148067 Sep 16 09:55:03.965324 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 310/618] 10.222.0.73 () {62 vars in 1200 bytes} [Fri Sep 16 09:55:03 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 160 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 16 09:55:04.923448 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-a2c93edc-0577-4377-932d-29070ab506e0 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:04.924055 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-a2c93edc-0577-4377-932d-29070ab506e0 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:04.935877 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a2c93edc-0577-4377-932d-29070ab506e0 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:04.936409 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a2c93edc-0577-4377-932d-29070ab506e0 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:04.936826 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a2c93edc-0577-4377-932d-29070ab506e0 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:04.938596 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a2c93edc-0577-4377-932d-29070ab506e0 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:04.939051 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a2c93edc-0577-4377-932d-29070ab506e0 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:04.939829 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a2c93edc-0577-4377-932d-29070ab506e0 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:05.139497 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-a2c93edc-0577-4377-932d-29070ab506e0 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:05.152765 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-a2c93edc-0577-4377-932d-29070ab506e0 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa" status: 200 len: 1735 microversion: 2.1 time: 0.233203 Sep 16 09:55:05.153763 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 309/619] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:04 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa => generated 1735 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:55:06.176180 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-173812bd-4fe8-4dfd-bf25-8cdb2a97bfc5 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:06.177481 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-173812bd-4fe8-4dfd-bf25-8cdb2a97bfc5 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:06.189855 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-173812bd-4fe8-4dfd-bf25-8cdb2a97bfc5 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:06.193879 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-173812bd-4fe8-4dfd-bf25-8cdb2a97bfc5 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:06.193879 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-173812bd-4fe8-4dfd-bf25-8cdb2a97bfc5 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:06.193879 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-173812bd-4fe8-4dfd-bf25-8cdb2a97bfc5 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:06.193879 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-173812bd-4fe8-4dfd-bf25-8cdb2a97bfc5 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:06.194275 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-173812bd-4fe8-4dfd-bf25-8cdb2a97bfc5 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:06.367529 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-173812bd-4fe8-4dfd-bf25-8cdb2a97bfc5 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:06.375887 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-173812bd-4fe8-4dfd-bf25-8cdb2a97bfc5 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa" status: 200 len: 1735 microversion: 2.1 time: 0.204034 Sep 16 09:55:06.376455 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 311/620] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:06 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa => generated 1735 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:55:06.507245 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-6667e71a-c0af-4871-845f-732938550f8f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-509748838", "imageRef": "30d28050-ec9d-4227-9bb0-5247430f6177", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fe465541-6175-450e-8791-dc7a519b5e60"}], "security_groups": [{"name": "tempest-securitygroup--134954606"}], "key_name": "tempest-keypair-1742301879", "user_data": "}} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:55:06.640313 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.network.neutron [None req-6667e71a-c0af-4871-845f-732938550f8f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] validate_networks() for [('fe465541-6175-450e-8791-dc7a519b5e60', None, None, None, None, None)] {{(pid=127671) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 09:55:07.049008 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.virt.hardware [None req-6667e71a-c0af-4871-845f-732938550f8f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Flavor limits 0:0:0 {{(pid=127671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 09:55:07.049610 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.virt.hardware [None req-6667e71a-c0af-4871-845f-732938550f8f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Image limits 0:0:0 {{(pid=127671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 09:55:07.050384 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.virt.hardware [None req-6667e71a-c0af-4871-845f-732938550f8f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Flavor pref 0:0:0 {{(pid=127671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 09:55:07.050863 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.virt.hardware [None req-6667e71a-c0af-4871-845f-732938550f8f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Image pref 0:0:0 {{(pid=127671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 09:55:07.051374 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.virt.hardware [None req-6667e71a-c0af-4871-845f-732938550f8f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 09:55:07.060190 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6667e71a-c0af-4871-845f-732938550f8f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:07.060754 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6667e71a-c0af-4871-845f-732938550f8f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:07.061256 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6667e71a-c0af-4871-845f-732938550f8f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:07.062087 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6667e71a-c0af-4871-845f-732938550f8f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:07.063218 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6667e71a-c0af-4871-845f-732938550f8f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:07.063972 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6667e71a-c0af-4871-845f-732938550f8f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:07.081262 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.quota [None req-6667e71a-c0af-4871-845f-732938550f8f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Getting quotas for project f1713f13f3ff494496a8ef8e5591c1b6. Resources: {'instances', 'cores', 'ram'} {{(pid=127671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 09:55:07.085351 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.quota [None req-6667e71a-c0af-4871-845f-732938550f8f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Getting quotas for user bc95a607e1ef43d592a5289f80464424 and project f1713f13f3ff494496a8ef8e5591c1b6. Resources: {'instances', 'cores', 'ram'} {{(pid=127671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 09:55:07.097247 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-6667e71a-c0af-4871-845f-732938550f8f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Going to run 1 instances... {{(pid=127671) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 09:55:07.099656 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-6667e71a-c0af-4871-845f-732938550f8f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='30d28050-ec9d-4227-9bb0-5247430f6177',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 09:55:07.227105 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-6667e71a-c0af-4871-845f-732938550f8f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.724279 Sep 16 09:55:07.227668 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 310/621] 10.222.0.73 () {62 vars in 1188 bytes} [Fri Sep 16 09:55:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 16 09:55:07.240052 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-103e5595-f9a9-4323-b72c-4e71e45a19b9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:07.240673 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-103e5595-f9a9-4323-b72c-4e71e45a19b9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:07.303527 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-103e5595-f9a9-4323-b72c-4e71e45a19b9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:07.309626 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-103e5595-f9a9-4323-b72c-4e71e45a19b9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:07.311207 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-103e5595-f9a9-4323-b72c-4e71e45a19b9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:07.312340 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-103e5595-f9a9-4323-b72c-4e71e45a19b9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1281 microversion: 2.20 time: 0.076370 Sep 16 09:55:07.313260 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 312/622] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:55:07 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1281 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 09:55:07.401921 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-e50ba22f-9f7e-4b53-b7bb-9e7154b3385f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:07.402530 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-e50ba22f-9f7e-4b53-b7bb-9e7154b3385f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:07.413939 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e50ba22f-9f7e-4b53-b7bb-9e7154b3385f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:07.420020 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e50ba22f-9f7e-4b53-b7bb-9e7154b3385f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:07.420020 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e50ba22f-9f7e-4b53-b7bb-9e7154b3385f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:07.420020 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e50ba22f-9f7e-4b53-b7bb-9e7154b3385f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:07.420020 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e50ba22f-9f7e-4b53-b7bb-9e7154b3385f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:07.420382 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e50ba22f-9f7e-4b53-b7bb-9e7154b3385f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:07.582873 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-e50ba22f-9f7e-4b53-b7bb-9e7154b3385f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:07.593645 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-e50ba22f-9f7e-4b53-b7bb-9e7154b3385f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa" status: 200 len: 1715 microversion: 2.1 time: 0.197540 Sep 16 09:55:07.598033 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 311/623] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:07 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa => generated 1715 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:55:07.716404 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-5bf0858d-668c-4c55-b2e3-4ff5c0451a68 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:07.717024 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-5bf0858d-668c-4c55-b2e3-4ff5c0451a68 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:07.723863 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5bf0858d-668c-4c55-b2e3-4ff5c0451a68 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:07.725143 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5bf0858d-668c-4c55-b2e3-4ff5c0451a68 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:07.725683 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5bf0858d-668c-4c55-b2e3-4ff5c0451a68 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:07.726307 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5bf0858d-668c-4c55-b2e3-4ff5c0451a68 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:07.727090 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5bf0858d-668c-4c55-b2e3-4ff5c0451a68 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:07.727675 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5bf0858d-668c-4c55-b2e3-4ff5c0451a68 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:07.820157 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.wsgi [None req-5bf0858d-668c-4c55-b2e3-4ff5c0451a68 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] HTTP exception thrown: Cannot 'detach_volume' instance bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa while it is in vm_state rescued Sep 16 09:55:07.821873 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-5bf0858d-668c-4c55-b2e3-4ff5c0451a68 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Request method failure captured: Sep 16 09:55:07.821873 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: request: DELETE /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa/os-volume_attachments/7ac2bcb1-a7b1-4e12-9c85-de588838b70e HTTP/1.1 Sep 16 09:55:07.821873 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept: application/json Sep 16 09:55:07.821873 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Sep 16 09:55:07.821873 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Connection: close Sep 16 09:55:07.821873 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Length: 0 Sep 16 09:55:07.821873 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Type: application/json Sep 16 09:55:07.821873 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Host: 10.222.0.73 Sep 16 09:55:07.821873 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Sep 16 09:55:07.821873 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Sep 16 09:55:07.821873 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjJEbxR-3pAhLiwb3ckUO6s_con7PzqaMH7LIfbFMfWWksbJi1GgWKz99k_xTyog5rd5nWR-OSR9_6_XhX2Wo2YD5uM25GUSMoNymOY18MnkEv9j1oga2G7G47Yhfh-dJVj2X4Cf2GB-s6CbFgJzG7jcNz64ctztxMfjiQALnI2E37Lf0 Sep 16 09:55:07.821873 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Sep 16 09:55:07.821873 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Sep 16 09:55:07.821873 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Sep 16 09:55:07.821873 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Sep 16 09:55:07.821873 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Sep 16 09:55:07.821873 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Sep 16 09:55:07.821873 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Id: 3fe0d52d42324aa38182b47b3588b979 Sep 16 09:55:07.821873 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1278542283 Sep 16 09:55:07.821873 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Role: reader,member Sep 16 09:55:07.821873 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Roles: reader,member Sep 16 09:55:07.823259 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/3fe0d52d42324aa38182b47b3588b979"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_3fe0d52d42324aa38182b47b3588b979", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/3fe0d52d42324aa38182b47b3588b979"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/3fe0d52d42324aa38182b47b3588b979"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 09:55:07.823259 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1278542283 Sep 16 09:55:07.823259 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Id: 3fe0d52d42324aa38182b47b3588b979 Sep 16 09:55:07.823259 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1278542283 Sep 16 09:55:07.823259 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User: tempest-ServerRescueNegativeTestJSON-1278542283-project Sep 16 09:55:07.823259 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Sep 16 09:55:07.823259 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Sep 16 09:55:07.823259 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Id: 8d1ce0bdadbc48d2899c7cdded5acb5c Sep 16 09:55:07.823259 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1278542283-project Sep 16 09:55:07.823259 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: method: > Sep 16 09:55:07.823259 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: exception: Cannot 'detach_volume' instance bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa while it is in vm_state rescued Sep 16 09:55:07.824050 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: action_args: {'server_id': 'bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa', 'id': '7ac2bcb1-a7b1-4e12-9c85-de588838b70e'} Sep 16 09:55:07.824050 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 09:55:07.824050 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:55:07.824050 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 16 09:55:07.824050 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 16 09:55:07.824050 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 16 09:55:07.824050 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 16 09:55:07.824050 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 16 09:55:07.824050 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 16 09:55:07.824050 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 16 09:55:07.824050 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:55:07.824050 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:55:07.824050 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:55:07.824050 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:55:07.824050 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:55:07.824050 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:55:07.824050 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 09:55:07.824050 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 09:55:07.824050 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 09:55:07.824050 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:55:07.825662 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 16 09:55:07.825662 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 16 09:55:07.825662 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 16 09:55:07.825662 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 16 09:55:07.825662 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa while it is in vm_state rescued Sep 16 09:55:07.825662 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:55:07.825662 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:55:07.825662 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:55:07.825662 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:55:07.825662 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:55:07.825662 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:55:07.825662 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 09:55:07.825662 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 09:55:07.825662 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa while it is in vm_state rescued Sep 16 09:55:07.825662 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:55:07.825662 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-5bf0858d-668c-4c55-b2e3-4ff5c0451a68 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Returning 409 to user: Cannot 'detach_volume' instance bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa while it is in vm_state rescued {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 09:55:07.826906 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-5bf0858d-668c-4c55-b2e3-4ff5c0451a68 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "DELETE /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa/os-volume_attachments/7ac2bcb1-a7b1-4e12-9c85-de588838b70e" status: 409 len: 152 microversion: 2.1 time: 0.111297 Sep 16 09:55:07.826906 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 313/624] 10.222.0.73 () {58 vars in 1416 bytes} [Fri Sep 16 09:55:07 2022] DELETE /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa/os-volume_attachments/7ac2bcb1-a7b1-4e12-9c85-de588838b70e => generated 152 bytes in 112 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 16 09:55:07.835299 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-d6305cc9-a31f-41da-9cb5-9e0bc6109287 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:55:07.835881 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-d6305cc9-a31f-41da-9cb5-9e0bc6109287 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:07.842432 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d6305cc9-a31f-41da-9cb5-9e0bc6109287 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:07.842996 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d6305cc9-a31f-41da-9cb5-9e0bc6109287 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:07.843445 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d6305cc9-a31f-41da-9cb5-9e0bc6109287 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:07.882472 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d6305cc9-a31f-41da-9cb5-9e0bc6109287 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:07.882472 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d6305cc9-a31f-41da-9cb5-9e0bc6109287 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:07.882472 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d6305cc9-a31f-41da-9cb5-9e0bc6109287 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:08.061968 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-d6305cc9-a31f-41da-9cb5-9e0bc6109287 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "POST /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa/action" status: 202 len: 0 microversion: 2.1 time: 0.231417 Sep 16 09:55:08.062736 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 312/625] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Sep 16 09:55:07 2022] POST /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 09:55:08.070774 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-2913b1c6-2535-49c6-98f5-2950adf475e8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:08.071390 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-2913b1c6-2535-49c6-98f5-2950adf475e8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:08.081221 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2913b1c6-2535-49c6-98f5-2950adf475e8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:08.081753 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2913b1c6-2535-49c6-98f5-2950adf475e8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:08.082193 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2913b1c6-2535-49c6-98f5-2950adf475e8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:08.082915 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2913b1c6-2535-49c6-98f5-2950adf475e8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:08.083384 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2913b1c6-2535-49c6-98f5-2950adf475e8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:08.083797 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2913b1c6-2535-49c6-98f5-2950adf475e8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:08.214719 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-5501ee47-237a-421a-ab26-f5a6d03f4af7 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Action: 'create', calling method: .version_select at 0x7ffa6db22c10>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-432505954", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFPJPRtGzIK+j/DscywP7gFhyj1OTx2qReGPmjkrUNiYalW1zmDtPtuen/BRX/DQuBhbBaQOf0xHZeT0bywHCuJnMxwX1AftOIFLq44RDBVjaecJ0TB2qfUF/kLpLtk0hg=="}} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:55:08.232269 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.quota [None req-5501ee47-237a-421a-ab26-f5a6d03f4af7 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Getting quotas for project c3ebe25211ee4dcb887de8e0c9a03040. Resources: {'key_pairs'} {{(pid=127671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 09:55:08.232754 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-2913b1c6-2535-49c6-98f5-2950adf475e8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:08.237122 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.quota [None req-5501ee47-237a-421a-ab26-f5a6d03f4af7 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Getting quotas for user b850cd7b216d4aab865886d20194f322 and project c3ebe25211ee4dcb887de8e0c9a03040. Resources: {'key_pairs'} {{(pid=127671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 09:55:08.243689 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-2913b1c6-2535-49c6-98f5-2950adf475e8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa" status: 200 len: 1723 microversion: 2.1 time: 0.176740 Sep 16 09:55:08.257992 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 314/626] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:08 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:55:08.317260 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-5501ee47-237a-421a-ab26-f5a6d03f4af7 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.106790 Sep 16 09:55:08.317979 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 313/627] 10.222.0.73 () {60 vars in 1159 bytes} [Fri Sep 16 09:55:08 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 09:55:08.338579 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-6ef8173d-3ade-4e19-b282-f6115a71a476 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:08.339548 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-6ef8173d-3ade-4e19-b282-f6115a71a476 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:08.349316 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6ef8173d-3ade-4e19-b282-f6115a71a476 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:08.350037 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6ef8173d-3ade-4e19-b282-f6115a71a476 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:08.350932 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6ef8173d-3ade-4e19-b282-f6115a71a476 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:08.352147 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6ef8173d-3ade-4e19-b282-f6115a71a476 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:08.353039 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6ef8173d-3ade-4e19-b282-f6115a71a476 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:08.353820 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6ef8173d-3ade-4e19-b282-f6115a71a476 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:08.426072 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-6ef8173d-3ade-4e19-b282-f6115a71a476 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:08.435442 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-6ef8173d-3ade-4e19-b282-f6115a71a476 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:08.436978 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-6ef8173d-3ade-4e19-b282-f6115a71a476 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:08.438708 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-6ef8173d-3ade-4e19-b282-f6115a71a476 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1285 microversion: 2.20 time: 0.104891 Sep 16 09:55:08.439458 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 315/628] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:55:08 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:55:08.442603 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-490676fb-cb6c-4b5c-a653-fb7ea4bf2d6f tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-227089410", "imageRef": "c5cab812-2e20-4580-8238-620b3800953a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-432505954", "networks": [{"uuid": "bcb00623-4b05-4b9d-bd71-6d191eabf6b0"}]}} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:55:08.504697 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.network.neutron [None req-490676fb-cb6c-4b5c-a653-fb7ea4bf2d6f tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] validate_networks() for [('bcb00623-4b05-4b9d-bd71-6d191eabf6b0', None, None, None, None, None)] {{(pid=127671) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 09:55:09.020577 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.virt.hardware [None req-490676fb-cb6c-4b5c-a653-fb7ea4bf2d6f tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Flavor limits 0:0:0 {{(pid=127671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 09:55:09.021142 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.virt.hardware [None req-490676fb-cb6c-4b5c-a653-fb7ea4bf2d6f tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Image limits 0:0:0 {{(pid=127671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 09:55:09.021603 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.virt.hardware [None req-490676fb-cb6c-4b5c-a653-fb7ea4bf2d6f tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Flavor pref 0:0:0 {{(pid=127671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 09:55:09.022012 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.virt.hardware [None req-490676fb-cb6c-4b5c-a653-fb7ea4bf2d6f tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Image pref 0:0:0 {{(pid=127671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 09:55:09.022426 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.virt.hardware [None req-490676fb-cb6c-4b5c-a653-fb7ea4bf2d6f tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 09:55:09.031912 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-490676fb-cb6c-4b5c-a653-fb7ea4bf2d6f tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:09.032250 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-490676fb-cb6c-4b5c-a653-fb7ea4bf2d6f tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:09.032684 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-490676fb-cb6c-4b5c-a653-fb7ea4bf2d6f tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:09.033608 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-490676fb-cb6c-4b5c-a653-fb7ea4bf2d6f tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:09.034067 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-490676fb-cb6c-4b5c-a653-fb7ea4bf2d6f tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:09.034491 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-490676fb-cb6c-4b5c-a653-fb7ea4bf2d6f tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:09.053931 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.quota [None req-490676fb-cb6c-4b5c-a653-fb7ea4bf2d6f tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Getting quotas for project c3ebe25211ee4dcb887de8e0c9a03040. Resources: {'instances', 'cores', 'ram'} {{(pid=127671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 09:55:09.058483 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.quota [None req-490676fb-cb6c-4b5c-a653-fb7ea4bf2d6f tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Getting quotas for user b850cd7b216d4aab865886d20194f322 and project c3ebe25211ee4dcb887de8e0c9a03040. Resources: {'instances', 'cores', 'ram'} {{(pid=127671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 09:55:09.077419 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-490676fb-cb6c-4b5c-a653-fb7ea4bf2d6f tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Going to run 1 instances... {{(pid=127671) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 09:55:09.080138 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-490676fb-cb6c-4b5c-a653-fb7ea4bf2d6f tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5cab812-2e20-4580-8238-620b3800953a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 09:55:09.197292 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-490676fb-cb6c-4b5c-a653-fb7ea4bf2d6f tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.759790 Sep 16 09:55:09.198088 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 314/629] 10.222.0.73 () {60 vars in 1147 bytes} [Fri Sep 16 09:55:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 16 09:55:09.209832 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-eec0938d-e476-4f41-ad24-a3b593e1f7fc tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:09.210453 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-eec0938d-e476-4f41-ad24-a3b593e1f7fc tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:09.270550 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-f4802898-636a-48e7-9b8b-53097f7c789b tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:09.271353 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-f4802898-636a-48e7-9b8b-53097f7c789b tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:09.278853 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f4802898-636a-48e7-9b8b-53097f7c789b tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:09.279453 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f4802898-636a-48e7-9b8b-53097f7c789b tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:09.279899 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f4802898-636a-48e7-9b8b-53097f7c789b tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:09.280678 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f4802898-636a-48e7-9b8b-53097f7c789b tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:09.281234 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f4802898-636a-48e7-9b8b-53097f7c789b tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:09.282384 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f4802898-636a-48e7-9b8b-53097f7c789b tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:09.289434 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-eec0938d-e476-4f41-ad24-a3b593e1f7fc tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b850cd7b216d4aab865886d20194f322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ebe25211ee4dcb887de8e0c9a03040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:09.297116 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-eec0938d-e476-4f41-ad24-a3b593e1f7fc tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a" status: 200 len: 1257 microversion: 2.1 time: 0.091400 Sep 16 09:55:09.297911 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 316/630] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:09 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a => generated 1257 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:55:09.451633 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-f4802898-636a-48e7-9b8b-53097f7c789b tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:09.451633 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-f4802898-636a-48e7-9b8b-53097f7c789b tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa" status: 200 len: 1723 microversion: 2.1 time: 0.186647 Sep 16 09:55:09.451633 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 315/631] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:09 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:55:09.466199 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-ddf1cced-ad2e-4cda-a6c5-b07520bfcd67 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:09.466820 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-ddf1cced-ad2e-4cda-a6c5-b07520bfcd67 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:09.474676 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ddf1cced-ad2e-4cda-a6c5-b07520bfcd67 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:09.475169 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ddf1cced-ad2e-4cda-a6c5-b07520bfcd67 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:09.475609 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ddf1cced-ad2e-4cda-a6c5-b07520bfcd67 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:09.476690 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ddf1cced-ad2e-4cda-a6c5-b07520bfcd67 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:09.477209 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ddf1cced-ad2e-4cda-a6c5-b07520bfcd67 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:09.477680 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ddf1cced-ad2e-4cda-a6c5-b07520bfcd67 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:09.545247 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-ddf1cced-ad2e-4cda-a6c5-b07520bfcd67 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:09.553285 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-ddf1cced-ad2e-4cda-a6c5-b07520bfcd67 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:09.554758 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-ddf1cced-ad2e-4cda-a6c5-b07520bfcd67 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:09.555853 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-ddf1cced-ad2e-4cda-a6c5-b07520bfcd67 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1333 microversion: 2.20 time: 0.094723 Sep 16 09:55:09.556410 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 317/632] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:55:09 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1333 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:55:10.323087 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-d38450da-9dc1-4e14-bcc0-10c65b55fc72 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:10.323841 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-d38450da-9dc1-4e14-bcc0-10c65b55fc72 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:10.379781 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-d38450da-9dc1-4e14-bcc0-10c65b55fc72 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b850cd7b216d4aab865886d20194f322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ebe25211ee4dcb887de8e0c9a03040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:10.387731 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-d38450da-9dc1-4e14-bcc0-10c65b55fc72 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a" status: 200 len: 1257 microversion: 2.1 time: 0.068423 Sep 16 09:55:10.388538 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 316/633] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:10 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a => generated 1257 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:55:10.474992 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-2ead60e3-3423-4347-a594-5c0946f6e29c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:10.475573 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-2ead60e3-3423-4347-a594-5c0946f6e29c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:10.482697 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2ead60e3-3423-4347-a594-5c0946f6e29c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:10.486149 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2ead60e3-3423-4347-a594-5c0946f6e29c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:10.486149 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2ead60e3-3423-4347-a594-5c0946f6e29c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:10.486149 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2ead60e3-3423-4347-a594-5c0946f6e29c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:10.486149 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2ead60e3-3423-4347-a594-5c0946f6e29c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:10.486573 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2ead60e3-3423-4347-a594-5c0946f6e29c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:10.581101 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-3041a6da-dcbb-4815-b371-5ab978c0b550 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:10.581817 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-3041a6da-dcbb-4815-b371-5ab978c0b550 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:10.588968 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3041a6da-dcbb-4815-b371-5ab978c0b550 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:10.589470 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3041a6da-dcbb-4815-b371-5ab978c0b550 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:10.589945 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3041a6da-dcbb-4815-b371-5ab978c0b550 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:10.590665 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3041a6da-dcbb-4815-b371-5ab978c0b550 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:10.591133 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3041a6da-dcbb-4815-b371-5ab978c0b550 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:10.591566 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3041a6da-dcbb-4815-b371-5ab978c0b550 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:10.656454 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-3041a6da-dcbb-4815-b371-5ab978c0b550 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:10.666077 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-3041a6da-dcbb-4815-b371-5ab978c0b550 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:10.667660 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-3041a6da-dcbb-4815-b371-5ab978c0b550 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:10.668782 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-3041a6da-dcbb-4815-b371-5ab978c0b550 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1333 microversion: 2.20 time: 0.092241 Sep 16 09:55:10.669339 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 317/634] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:55:10 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1333 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:55:10.863954 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-2ead60e3-3423-4347-a594-5c0946f6e29c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:10.872171 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-2ead60e3-3423-4347-a594-5c0946f6e29c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa" status: 200 len: 1723 microversion: 2.1 time: 0.401273 Sep 16 09:55:10.872723 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 318/635] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:10 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa => generated 1723 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:55:11.411561 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-158ab613-89f7-4f28-87c8-bcaf43f4dbe3 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:11.412212 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-158ab613-89f7-4f28-87c8-bcaf43f4dbe3 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:11.418886 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-158ab613-89f7-4f28-87c8-bcaf43f4dbe3 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:11.419378 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-158ab613-89f7-4f28-87c8-bcaf43f4dbe3 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:11.419822 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-158ab613-89f7-4f28-87c8-bcaf43f4dbe3 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:11.420520 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-158ab613-89f7-4f28-87c8-bcaf43f4dbe3 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:11.420982 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-158ab613-89f7-4f28-87c8-bcaf43f4dbe3 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:11.421412 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-158ab613-89f7-4f28-87c8-bcaf43f4dbe3 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:11.482501 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-158ab613-89f7-4f28-87c8-bcaf43f4dbe3 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b850cd7b216d4aab865886d20194f322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ebe25211ee4dcb887de8e0c9a03040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:11.490233 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-158ab613-89f7-4f28-87c8-bcaf43f4dbe3 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a" status: 200 len: 1261 microversion: 2.1 time: 0.083501 Sep 16 09:55:11.490793 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 318/636] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:11 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a => generated 1261 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:55:11.695111 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-bcb87754-6bb8-4959-a020-464f9013c587 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:11.695662 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-bcb87754-6bb8-4959-a020-464f9013c587 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:11.702144 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bcb87754-6bb8-4959-a020-464f9013c587 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:11.702633 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bcb87754-6bb8-4959-a020-464f9013c587 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:11.703073 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bcb87754-6bb8-4959-a020-464f9013c587 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:11.704263 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bcb87754-6bb8-4959-a020-464f9013c587 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:11.704817 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bcb87754-6bb8-4959-a020-464f9013c587 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:11.705251 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bcb87754-6bb8-4959-a020-464f9013c587 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:11.768157 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-bcb87754-6bb8-4959-a020-464f9013c587 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:11.776864 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-bcb87754-6bb8-4959-a020-464f9013c587 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:11.778379 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-bcb87754-6bb8-4959-a020-464f9013c587 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:11.779486 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-bcb87754-6bb8-4959-a020-464f9013c587 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1333 microversion: 2.20 time: 0.088321 Sep 16 09:55:11.780050 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 319/637] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:55:11 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1333 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:55:11.895132 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-bac34443-5478-43a7-94b4-c2eafba58ea0 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:11.895731 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-bac34443-5478-43a7-94b4-c2eafba58ea0 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:11.901649 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-bac34443-5478-43a7-94b4-c2eafba58ea0 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:11.902129 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-bac34443-5478-43a7-94b4-c2eafba58ea0 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:11.902564 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-bac34443-5478-43a7-94b4-c2eafba58ea0 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:11.903245 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-bac34443-5478-43a7-94b4-c2eafba58ea0 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:11.903699 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-bac34443-5478-43a7-94b4-c2eafba58ea0 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:11.904116 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-bac34443-5478-43a7-94b4-c2eafba58ea0 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:12.033006 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-bac34443-5478-43a7-94b4-c2eafba58ea0 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:12.041159 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-bac34443-5478-43a7-94b4-c2eafba58ea0 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa" status: 200 len: 1723 microversion: 2.1 time: 0.149900 Sep 16 09:55:12.041757 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 319/638] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:11 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:55:12.512589 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-91e4d7c5-298b-4ee6-81be-a7c41b856cce tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:12.513210 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-91e4d7c5-298b-4ee6-81be-a7c41b856cce tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:12.515112 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:55:12.520595 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-91e4d7c5-298b-4ee6-81be-a7c41b856cce tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:12.521087 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-91e4d7c5-298b-4ee6-81be-a7c41b856cce tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:12.521531 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-91e4d7c5-298b-4ee6-81be-a7c41b856cce tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:12.522265 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-91e4d7c5-298b-4ee6-81be-a7c41b856cce tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:12.522710 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-91e4d7c5-298b-4ee6-81be-a7c41b856cce tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:12.523141 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-91e4d7c5-298b-4ee6-81be-a7c41b856cce tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:12.584779 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-91e4d7c5-298b-4ee6-81be-a7c41b856cce tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b850cd7b216d4aab865886d20194f322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ebe25211ee4dcb887de8e0c9a03040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:12.592395 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-91e4d7c5-298b-4ee6-81be-a7c41b856cce tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a" status: 200 len: 1261 microversion: 2.1 time: 0.083555 Sep 16 09:55:12.592956 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 320/639] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:12 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a => generated 1261 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:55:12.804380 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-618e81e8-9313-44fb-b0d9-be70e4e0293f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:12.804992 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-618e81e8-9313-44fb-b0d9-be70e4e0293f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:12.811592 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-618e81e8-9313-44fb-b0d9-be70e4e0293f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:12.812078 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-618e81e8-9313-44fb-b0d9-be70e4e0293f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:12.815228 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-618e81e8-9313-44fb-b0d9-be70e4e0293f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:12.815228 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-618e81e8-9313-44fb-b0d9-be70e4e0293f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:12.815228 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-618e81e8-9313-44fb-b0d9-be70e4e0293f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:12.815228 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-618e81e8-9313-44fb-b0d9-be70e4e0293f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:12.879096 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-618e81e8-9313-44fb-b0d9-be70e4e0293f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:12.888742 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-618e81e8-9313-44fb-b0d9-be70e4e0293f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:12.891679 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-618e81e8-9313-44fb-b0d9-be70e4e0293f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:12.892105 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-618e81e8-9313-44fb-b0d9-be70e4e0293f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1333 microversion: 2.20 time: 0.091604 Sep 16 09:55:12.893009 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 320/640] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:55:12 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1333 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:55:13.065442 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-1fcf2345-e335-4e05-a76d-7390c5aa3349 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:13.066099 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-1fcf2345-e335-4e05-a76d-7390c5aa3349 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:13.073052 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1fcf2345-e335-4e05-a76d-7390c5aa3349 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:13.074828 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1fcf2345-e335-4e05-a76d-7390c5aa3349 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:13.074828 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1fcf2345-e335-4e05-a76d-7390c5aa3349 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:13.074828 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1fcf2345-e335-4e05-a76d-7390c5aa3349 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:13.075240 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1fcf2345-e335-4e05-a76d-7390c5aa3349 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:13.075670 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1fcf2345-e335-4e05-a76d-7390c5aa3349 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:13.207877 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-1fcf2345-e335-4e05-a76d-7390c5aa3349 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:13.215970 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-1fcf2345-e335-4e05-a76d-7390c5aa3349 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa" status: 200 len: 1723 microversion: 2.1 time: 0.155229 Sep 16 09:55:13.216554 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 321/641] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:13 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:55:13.615750 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-8130a895-ea96-4eed-9b46-82bb58da3fcb tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:13.616522 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-8130a895-ea96-4eed-9b46-82bb58da3fcb tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:13.622507 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8130a895-ea96-4eed-9b46-82bb58da3fcb tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:13.622991 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8130a895-ea96-4eed-9b46-82bb58da3fcb tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:13.623435 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8130a895-ea96-4eed-9b46-82bb58da3fcb tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:13.624123 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8130a895-ea96-4eed-9b46-82bb58da3fcb tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:13.624581 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8130a895-ea96-4eed-9b46-82bb58da3fcb tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:13.625007 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8130a895-ea96-4eed-9b46-82bb58da3fcb tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:13.688838 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-8130a895-ea96-4eed-9b46-82bb58da3fcb tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b850cd7b216d4aab865886d20194f322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ebe25211ee4dcb887de8e0c9a03040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:13.696694 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-8130a895-ea96-4eed-9b46-82bb58da3fcb tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a" status: 200 len: 1309 microversion: 2.1 time: 0.085053 Sep 16 09:55:13.697648 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 321/642] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:13 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a => generated 1309 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:55:13.916733 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-7c12d00e-b347-4c4f-9930-bb5f650125c1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:13.917415 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-7c12d00e-b347-4c4f-9930-bb5f650125c1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:13.925096 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7c12d00e-b347-4c4f-9930-bb5f650125c1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:13.925712 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7c12d00e-b347-4c4f-9930-bb5f650125c1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:13.926233 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7c12d00e-b347-4c4f-9930-bb5f650125c1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:13.927015 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7c12d00e-b347-4c4f-9930-bb5f650125c1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:13.927552 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7c12d00e-b347-4c4f-9930-bb5f650125c1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:13.928083 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7c12d00e-b347-4c4f-9930-bb5f650125c1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:14.001145 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-7c12d00e-b347-4c4f-9930-bb5f650125c1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:14.011074 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-7c12d00e-b347-4c4f-9930-bb5f650125c1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:14.012753 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-7c12d00e-b347-4c4f-9930-bb5f650125c1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:14.014030 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-7c12d00e-b347-4c4f-9930-bb5f650125c1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1341 microversion: 2.20 time: 0.101660 Sep 16 09:55:14.020735 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 322/643] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:55:13 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1341 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:55:14.240581 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-ce458992-cc6c-4afc-b2ac-ee02088d0e77 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:14.241197 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-ce458992-cc6c-4afc-b2ac-ee02088d0e77 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:14.247730 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ce458992-cc6c-4afc-b2ac-ee02088d0e77 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:14.249830 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ce458992-cc6c-4afc-b2ac-ee02088d0e77 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:14.249830 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ce458992-cc6c-4afc-b2ac-ee02088d0e77 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:14.249830 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ce458992-cc6c-4afc-b2ac-ee02088d0e77 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:14.250130 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ce458992-cc6c-4afc-b2ac-ee02088d0e77 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:14.250347 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ce458992-cc6c-4afc-b2ac-ee02088d0e77 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:14.452749 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-ce458992-cc6c-4afc-b2ac-ee02088d0e77 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:14.462477 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-ce458992-cc6c-4afc-b2ac-ee02088d0e77 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa" status: 200 len: 1729 microversion: 2.1 time: 0.225779 Sep 16 09:55:14.463071 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 322/644] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:14 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa => generated 1729 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:55:14.485813 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-ccfef778-4a65-4875-9dc0-918a6611cdc2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:14.486903 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-ccfef778-4a65-4875-9dc0-918a6611cdc2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:14.493223 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ccfef778-4a65-4875-9dc0-918a6611cdc2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:14.493753 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ccfef778-4a65-4875-9dc0-918a6611cdc2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:14.494195 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ccfef778-4a65-4875-9dc0-918a6611cdc2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:14.494895 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ccfef778-4a65-4875-9dc0-918a6611cdc2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:14.495357 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ccfef778-4a65-4875-9dc0-918a6611cdc2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:14.495786 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ccfef778-4a65-4875-9dc0-918a6611cdc2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:14.573921 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-ccfef778-4a65-4875-9dc0-918a6611cdc2 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092245 Sep 16 09:55:14.574606 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 323/645] 10.222.0.73 () {58 vars in 1275 bytes} [Fri Sep 16 09:55:14 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:55:14.722869 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-ab79fda5-b8f6-4177-8ceb-069621c98ae0 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:14.723502 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-ab79fda5-b8f6-4177-8ceb-069621c98ae0 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:14.730614 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ab79fda5-b8f6-4177-8ceb-069621c98ae0 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:14.731682 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ab79fda5-b8f6-4177-8ceb-069621c98ae0 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:14.732387 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ab79fda5-b8f6-4177-8ceb-069621c98ae0 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:14.733093 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ab79fda5-b8f6-4177-8ceb-069621c98ae0 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:14.733574 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ab79fda5-b8f6-4177-8ceb-069621c98ae0 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:14.734189 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ab79fda5-b8f6-4177-8ceb-069621c98ae0 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:14.754782 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:55:14.823585 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-ab79fda5-b8f6-4177-8ceb-069621c98ae0 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b850cd7b216d4aab865886d20194f322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ebe25211ee4dcb887de8e0c9a03040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:14.834425 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-ab79fda5-b8f6-4177-8ceb-069621c98ae0 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a" status: 200 len: 1309 microversion: 2.1 time: 0.117414 Sep 16 09:55:14.842383 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 323/646] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:14 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a => generated 1309 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:55:15.044272 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-8a21784b-0499-40fc-962f-603929f6831f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:15.045828 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-8a21784b-0499-40fc-962f-603929f6831f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:15.056135 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8a21784b-0499-40fc-962f-603929f6831f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:15.061707 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8a21784b-0499-40fc-962f-603929f6831f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:15.061707 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8a21784b-0499-40fc-962f-603929f6831f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:15.061707 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8a21784b-0499-40fc-962f-603929f6831f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:15.061707 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8a21784b-0499-40fc-962f-603929f6831f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:15.062230 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8a21784b-0499-40fc-962f-603929f6831f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:15.242451 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-8a21784b-0499-40fc-962f-603929f6831f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:15.251152 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-8a21784b-0499-40fc-962f-603929f6831f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:15.252594 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-8a21784b-0499-40fc-962f-603929f6831f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:15.253739 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-8a21784b-0499-40fc-962f-603929f6831f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1406 microversion: 2.20 time: 0.216971 Sep 16 09:55:15.254343 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 324/647] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:55:15 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1406 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:55:15.635440 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [req-da16c681-94fb-4e36-b2b5-773bf7528643 req-7b4dadca-20a0-4151-8b20-fef4eaa36bb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa", "tag": "6851d923-796f-41a3-a0d3-de42390996fa"}]} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:55:15.647006 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-da16c681-94fb-4e36-b2b5-773bf7528643 req-7b4dadca-20a0-4151-8b20-fef4eaa36bb3 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:15.647728 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-da16c681-94fb-4e36-b2b5-773bf7528643 req-7b4dadca-20a0-4151-8b20-fef4eaa36bb3 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:15.648170 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-da16c681-94fb-4e36-b2b5-773bf7528643 req-7b4dadca-20a0-4151-8b20-fef4eaa36bb3 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:15.662810 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.compute.server_external_events [req-da16c681-94fb-4e36-b2b5-773bf7528643 req-7b4dadca-20a0-4151-8b20-fef4eaa36bb3 service nova] Creating event network-changed:6851d923-796f-41a3-a0d3-de42390996fa for instance bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa on hv-cinder-79053 Sep 16 09:55:15.668196 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [req-da16c681-94fb-4e36-b2b5-773bf7528643 req-7b4dadca-20a0-4151-8b20-fef4eaa36bb3 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036601 Sep 16 09:55:15.668801 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 324/648] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:55:15.858512 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-cdece338-6e78-41cc-bcdf-a99bd7058129 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:15.858907 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-cdece338-6e78-41cc-bcdf-a99bd7058129 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:15.866335 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cdece338-6e78-41cc-bcdf-a99bd7058129 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:15.866478 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cdece338-6e78-41cc-bcdf-a99bd7058129 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:15.866889 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cdece338-6e78-41cc-bcdf-a99bd7058129 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:15.867797 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cdece338-6e78-41cc-bcdf-a99bd7058129 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:15.868268 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cdece338-6e78-41cc-bcdf-a99bd7058129 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:15.868700 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cdece338-6e78-41cc-bcdf-a99bd7058129 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:15.932759 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-cdece338-6e78-41cc-bcdf-a99bd7058129 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b850cd7b216d4aab865886d20194f322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ebe25211ee4dcb887de8e0c9a03040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:15.940983 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-cdece338-6e78-41cc-bcdf-a99bd7058129 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a" status: 200 len: 1309 microversion: 2.1 time: 0.088474 Sep 16 09:55:15.941615 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 325/649] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:15 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a => generated 1309 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:55:16.280530 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-3494f1ff-78b3-4e38-8f65-df115a67920c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:16.281176 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-3494f1ff-78b3-4e38-8f65-df115a67920c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:16.288673 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3494f1ff-78b3-4e38-8f65-df115a67920c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:16.289161 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3494f1ff-78b3-4e38-8f65-df115a67920c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:16.289632 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3494f1ff-78b3-4e38-8f65-df115a67920c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:16.290360 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3494f1ff-78b3-4e38-8f65-df115a67920c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:16.290803 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3494f1ff-78b3-4e38-8f65-df115a67920c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:16.291232 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3494f1ff-78b3-4e38-8f65-df115a67920c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:16.435614 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-3494f1ff-78b3-4e38-8f65-df115a67920c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:16.444551 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-3494f1ff-78b3-4e38-8f65-df115a67920c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:16.446079 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-3494f1ff-78b3-4e38-8f65-df115a67920c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:16.447226 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-3494f1ff-78b3-4e38-8f65-df115a67920c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1406 microversion: 2.20 time: 0.171141 Sep 16 09:55:16.447787 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 325/650] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:55:16 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:55:16.971008 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-23e28306-c554-491a-b997-c2a979706e95 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:16.972200 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-23e28306-c554-491a-b997-c2a979706e95 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:16.979494 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-23e28306-c554-491a-b997-c2a979706e95 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:16.980020 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-23e28306-c554-491a-b997-c2a979706e95 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:16.980505 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-23e28306-c554-491a-b997-c2a979706e95 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:16.981209 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-23e28306-c554-491a-b997-c2a979706e95 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:16.982146 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-23e28306-c554-491a-b997-c2a979706e95 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:16.982401 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-23e28306-c554-491a-b997-c2a979706e95 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:17.045710 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-23e28306-c554-491a-b997-c2a979706e95 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b850cd7b216d4aab865886d20194f322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ebe25211ee4dcb887de8e0c9a03040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:17.053384 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-23e28306-c554-491a-b997-c2a979706e95 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a" status: 200 len: 1309 microversion: 2.1 time: 0.093971 Sep 16 09:55:17.054008 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 326/651] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:16 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a => generated 1309 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:55:17.476970 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-bba7cd30-b092-4a60-bf59-825297472374 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:17.478438 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-bba7cd30-b092-4a60-bf59-825297472374 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:17.490950 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-bba7cd30-b092-4a60-bf59-825297472374 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:17.491721 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-bba7cd30-b092-4a60-bf59-825297472374 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:17.492344 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-bba7cd30-b092-4a60-bf59-825297472374 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:17.493926 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-bba7cd30-b092-4a60-bf59-825297472374 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:17.494547 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-bba7cd30-b092-4a60-bf59-825297472374 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:17.503562 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-bba7cd30-b092-4a60-bf59-825297472374 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:17.695625 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-2cf97a18-2da3-4ba8-8752-5ec0a2f9b35d req-c2c28dd5-05df-4a6f-be1d-223df8513dd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa", "tag": "6851d923-796f-41a3-a0d3-de42390996fa"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:55:17.717980 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-2cf97a18-2da3-4ba8-8752-5ec0a2f9b35d req-c2c28dd5-05df-4a6f-be1d-223df8513dd6 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:17.718088 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-2cf97a18-2da3-4ba8-8752-5ec0a2f9b35d req-c2c28dd5-05df-4a6f-be1d-223df8513dd6 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:17.720589 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-2cf97a18-2da3-4ba8-8752-5ec0a2f9b35d req-c2c28dd5-05df-4a6f-be1d-223df8513dd6 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:17.744187 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-2cf97a18-2da3-4ba8-8752-5ec0a2f9b35d req-c2c28dd5-05df-4a6f-be1d-223df8513dd6 service nova] Creating event network-changed:6851d923-796f-41a3-a0d3-de42390996fa for instance bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa on hv-cinder-79053 Sep 16 09:55:17.749850 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-2cf97a18-2da3-4ba8-8752-5ec0a2f9b35d req-c2c28dd5-05df-4a6f-be1d-223df8513dd6 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057891 Sep 16 09:55:17.752040 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 327/652] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:55:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:55:17.756586 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-bba7cd30-b092-4a60-bf59-825297472374 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:17.767327 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-bba7cd30-b092-4a60-bf59-825297472374 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:17.768988 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-bba7cd30-b092-4a60-bf59-825297472374 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:17.770353 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-bba7cd30-b092-4a60-bf59-825297472374 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1406 microversion: 2.20 time: 0.297792 Sep 16 09:55:17.780748 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 326/653] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:55:17 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1406 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:55:18.022495 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-89b96005-5009-49f9-8c7d-d25380bf5d3a req-aa5cbaec-4295-4d2f-b340-c8be56e624f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0f4a754-d9db-4829-a2f8-677cc9c34fbc", "tag": "789fb3b6-eef8-4edd-a929-e88fed92432d"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:55:18.049877 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-89b96005-5009-49f9-8c7d-d25380bf5d3a req-aa5cbaec-4295-4d2f-b340-c8be56e624f0 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:18.050643 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-89b96005-5009-49f9-8c7d-d25380bf5d3a req-aa5cbaec-4295-4d2f-b340-c8be56e624f0 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:18.051304 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-89b96005-5009-49f9-8c7d-d25380bf5d3a req-aa5cbaec-4295-4d2f-b340-c8be56e624f0 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:18.076391 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-3bd9c47d-a7e1-449d-96b7-519d6f1e538e tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:18.077213 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-3bd9c47d-a7e1-449d-96b7-519d6f1e538e tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:18.087090 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-89b96005-5009-49f9-8c7d-d25380bf5d3a req-aa5cbaec-4295-4d2f-b340-c8be56e624f0 service nova] Creating event network-changed:789fb3b6-eef8-4edd-a929-e88fed92432d for instance e0f4a754-d9db-4829-a2f8-677cc9c34fbc on hv-cinder-79053 Sep 16 09:55:18.090301 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3bd9c47d-a7e1-449d-96b7-519d6f1e538e tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:18.090907 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3bd9c47d-a7e1-449d-96b7-519d6f1e538e tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:18.097681 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3bd9c47d-a7e1-449d-96b7-519d6f1e538e tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:18.097681 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3bd9c47d-a7e1-449d-96b7-519d6f1e538e tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:18.097681 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3bd9c47d-a7e1-449d-96b7-519d6f1e538e tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:18.097681 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3bd9c47d-a7e1-449d-96b7-519d6f1e538e tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:18.110103 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-89b96005-5009-49f9-8c7d-d25380bf5d3a req-aa5cbaec-4295-4d2f-b340-c8be56e624f0 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093142 Sep 16 09:55:18.112402 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 328/654] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:55:18.251347 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-3bd9c47d-a7e1-449d-96b7-519d6f1e538e tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b850cd7b216d4aab865886d20194f322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ebe25211ee4dcb887de8e0c9a03040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:18.276095 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-3bd9c47d-a7e1-449d-96b7-519d6f1e538e tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a" status: 200 len: 1315 microversion: 2.1 time: 0.200813 Sep 16 09:55:18.286517 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 327/655] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:18 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:55:18.798600 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-e59842a2-09a1-4c62-95f3-edeefd5bcd36 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:18.799351 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-e59842a2-09a1-4c62-95f3-edeefd5bcd36 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:18.806298 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e59842a2-09a1-4c62-95f3-edeefd5bcd36 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:18.807024 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e59842a2-09a1-4c62-95f3-edeefd5bcd36 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:18.807644 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e59842a2-09a1-4c62-95f3-edeefd5bcd36 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:18.808526 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e59842a2-09a1-4c62-95f3-edeefd5bcd36 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:18.809225 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e59842a2-09a1-4c62-95f3-edeefd5bcd36 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:18.809836 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e59842a2-09a1-4c62-95f3-edeefd5bcd36 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:18.813779 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=100 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:55:19.014638 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-e59842a2-09a1-4c62-95f3-edeefd5bcd36 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:19.019783 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-e59842a2-09a1-4c62-95f3-edeefd5bcd36 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:19.021493 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-e59842a2-09a1-4c62-95f3-edeefd5bcd36 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:19.022811 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-e59842a2-09a1-4c62-95f3-edeefd5bcd36 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1406 microversion: 2.20 time: 0.229066 Sep 16 09:55:19.024007 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 329/656] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:55:18 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1406 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:55:19.311403 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-51b66ed3-6adb-4843-a40a-41b12f055b5f tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:19.312117 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-51b66ed3-6adb-4843-a40a-41b12f055b5f tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:19.314852 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell0:SELECT=4 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:55:19.332288 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-51b66ed3-6adb-4843-a40a-41b12f055b5f tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:19.334426 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-51b66ed3-6adb-4843-a40a-41b12f055b5f tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:19.343612 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-51b66ed3-6adb-4843-a40a-41b12f055b5f tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:19.343612 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-51b66ed3-6adb-4843-a40a-41b12f055b5f tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:19.343612 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-51b66ed3-6adb-4843-a40a-41b12f055b5f tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:19.343612 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-51b66ed3-6adb-4843-a40a-41b12f055b5f tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:19.537121 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-51b66ed3-6adb-4843-a40a-41b12f055b5f tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b850cd7b216d4aab865886d20194f322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ebe25211ee4dcb887de8e0c9a03040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:19.545177 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-51b66ed3-6adb-4843-a40a-41b12f055b5f tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a" status: 200 len: 1357 microversion: 2.1 time: 0.237603 Sep 16 09:55:19.545784 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 328/657] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:19 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a => generated 1357 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:55:20.049986 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-b1617c22-c1fd-436a-b118-a901973b4414 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:20.051236 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-b1617c22-c1fd-436a-b118-a901973b4414 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:20.057116 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell0:SELECT=8 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:55:20.059599 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b1617c22-c1fd-436a-b118-a901973b4414 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:20.060093 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b1617c22-c1fd-436a-b118-a901973b4414 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:20.060528 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b1617c22-c1fd-436a-b118-a901973b4414 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:20.061237 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b1617c22-c1fd-436a-b118-a901973b4414 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:20.061845 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b1617c22-c1fd-436a-b118-a901973b4414 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:20.062456 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b1617c22-c1fd-436a-b118-a901973b4414 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:20.209702 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-b1617c22-c1fd-436a-b118-a901973b4414 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:20.217837 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-b1617c22-c1fd-436a-b118-a901973b4414 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:20.220361 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-b1617c22-c1fd-436a-b118-a901973b4414 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:20.221754 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-b1617c22-c1fd-436a-b118-a901973b4414 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1406 microversion: 2.20 time: 0.177129 Sep 16 09:55:20.222633 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 330/658] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:55:20 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:55:20.566508 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell0:SELECT=18 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:55:20.572158 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-231ce92d-c8bd-4f67-bfe5-a82081fab050 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:20.573276 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-231ce92d-c8bd-4f67-bfe5-a82081fab050 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:20.582574 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-231ce92d-c8bd-4f67-bfe5-a82081fab050 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:20.584162 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-231ce92d-c8bd-4f67-bfe5-a82081fab050 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:20.584781 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-231ce92d-c8bd-4f67-bfe5-a82081fab050 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:20.585714 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-231ce92d-c8bd-4f67-bfe5-a82081fab050 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:20.586553 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-231ce92d-c8bd-4f67-bfe5-a82081fab050 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:20.587159 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-231ce92d-c8bd-4f67-bfe5-a82081fab050 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:20.761977 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-231ce92d-c8bd-4f67-bfe5-a82081fab050 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b850cd7b216d4aab865886d20194f322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ebe25211ee4dcb887de8e0c9a03040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:20.773785 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-231ce92d-c8bd-4f67-bfe5-a82081fab050 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a" status: 200 len: 1357 microversion: 2.1 time: 0.205936 Sep 16 09:55:20.773785 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 329/659] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:20 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a => generated 1357 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:55:21.253871 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-f47277b3-81be-453f-b18a-987b3077934a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:21.254424 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-f47277b3-81be-453f-b18a-987b3077934a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:21.260801 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f47277b3-81be-453f-b18a-987b3077934a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:21.261291 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f47277b3-81be-453f-b18a-987b3077934a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:21.261770 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f47277b3-81be-453f-b18a-987b3077934a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:21.262468 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f47277b3-81be-453f-b18a-987b3077934a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:21.262930 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f47277b3-81be-453f-b18a-987b3077934a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:21.263360 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f47277b3-81be-453f-b18a-987b3077934a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:21.399840 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f47277b3-81be-453f-b18a-987b3077934a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:21.408194 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f47277b3-81be-453f-b18a-987b3077934a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:21.409705 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f47277b3-81be-453f-b18a-987b3077934a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:21.410735 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-f47277b3-81be-453f-b18a-987b3077934a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1406 microversion: 2.20 time: 0.161700 Sep 16 09:55:21.411291 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 331/660] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:55:21 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:55:21.794431 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-8bfec643-07cb-4646-a30e-9cbdc201c303 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:21.795248 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-8bfec643-07cb-4646-a30e-9cbdc201c303 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:21.802554 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8bfec643-07cb-4646-a30e-9cbdc201c303 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:21.803039 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8bfec643-07cb-4646-a30e-9cbdc201c303 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:21.803622 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8bfec643-07cb-4646-a30e-9cbdc201c303 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:21.804307 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8bfec643-07cb-4646-a30e-9cbdc201c303 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:21.804763 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8bfec643-07cb-4646-a30e-9cbdc201c303 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:21.805189 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8bfec643-07cb-4646-a30e-9cbdc201c303 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:21.951081 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-8bfec643-07cb-4646-a30e-9cbdc201c303 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b850cd7b216d4aab865886d20194f322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ebe25211ee4dcb887de8e0c9a03040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:21.966213 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-8bfec643-07cb-4646-a30e-9cbdc201c303 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a" status: 200 len: 1357 microversion: 2.1 time: 0.175644 Sep 16 09:55:21.966807 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 330/661] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:21 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:55:22.439856 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-a38b5895-afc0-4893-8fe5-f6aa8650f7f5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:22.443004 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-a38b5895-afc0-4893-8fe5-f6aa8650f7f5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:22.464551 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a38b5895-afc0-4893-8fe5-f6aa8650f7f5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:22.465280 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a38b5895-afc0-4893-8fe5-f6aa8650f7f5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:22.465825 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a38b5895-afc0-4893-8fe5-f6aa8650f7f5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:22.466585 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a38b5895-afc0-4893-8fe5-f6aa8650f7f5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:22.467082 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a38b5895-afc0-4893-8fe5-f6aa8650f7f5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:22.467527 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a38b5895-afc0-4893-8fe5-f6aa8650f7f5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:22.648872 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-a38b5895-afc0-4893-8fe5-f6aa8650f7f5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:22.659370 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-a38b5895-afc0-4893-8fe5-f6aa8650f7f5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:22.661012 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-a38b5895-afc0-4893-8fe5-f6aa8650f7f5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:22.662345 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-a38b5895-afc0-4893-8fe5-f6aa8650f7f5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1406 microversion: 2.20 time: 0.228974 Sep 16 09:55:22.678202 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 332/662] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:55:22 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1406 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:55:22.994221 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-765ed9b0-a0a5-4f99-867c-cd605ea353f3 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:22.995265 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-765ed9b0-a0a5-4f99-867c-cd605ea353f3 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:23.003716 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:55:23.005702 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-765ed9b0-a0a5-4f99-867c-cd605ea353f3 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:23.006286 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-765ed9b0-a0a5-4f99-867c-cd605ea353f3 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:23.006880 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-765ed9b0-a0a5-4f99-867c-cd605ea353f3 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:23.007554 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-765ed9b0-a0a5-4f99-867c-cd605ea353f3 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:23.008110 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-765ed9b0-a0a5-4f99-867c-cd605ea353f3 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:23.008548 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-765ed9b0-a0a5-4f99-867c-cd605ea353f3 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:23.155927 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-765ed9b0-a0a5-4f99-867c-cd605ea353f3 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b850cd7b216d4aab865886d20194f322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ebe25211ee4dcb887de8e0c9a03040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:23.165463 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-765ed9b0-a0a5-4f99-867c-cd605ea353f3 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a" status: 200 len: 1357 microversion: 2.1 time: 0.178586 Sep 16 09:55:23.166389 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 331/663] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:22 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a => generated 1357 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:55:23.688760 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-5cbc488d-6c04-4eb2-8968-f520e0fbfe1d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:23.689566 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-5cbc488d-6c04-4eb2-8968-f520e0fbfe1d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:23.696234 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5cbc488d-6c04-4eb2-8968-f520e0fbfe1d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:23.696725 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5cbc488d-6c04-4eb2-8968-f520e0fbfe1d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:23.697163 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5cbc488d-6c04-4eb2-8968-f520e0fbfe1d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:23.697903 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5cbc488d-6c04-4eb2-8968-f520e0fbfe1d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:23.698362 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5cbc488d-6c04-4eb2-8968-f520e0fbfe1d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:23.698787 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5cbc488d-6c04-4eb2-8968-f520e0fbfe1d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:23.846466 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-5cbc488d-6c04-4eb2-8968-f520e0fbfe1d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:23.855172 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-5cbc488d-6c04-4eb2-8968-f520e0fbfe1d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:23.857255 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-5cbc488d-6c04-4eb2-8968-f520e0fbfe1d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:23.858674 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-5cbc488d-6c04-4eb2-8968-f520e0fbfe1d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1406 microversion: 2.20 time: 0.174371 Sep 16 09:55:23.876264 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 333/664] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:55:23 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1406 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:55:24.191243 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-3d59090f-a4b8-41e7-ab43-bd841d101d1c tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:24.192202 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-3d59090f-a4b8-41e7-ab43-bd841d101d1c tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:24.198930 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3d59090f-a4b8-41e7-ab43-bd841d101d1c tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:24.199272 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3d59090f-a4b8-41e7-ab43-bd841d101d1c tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:24.199722 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3d59090f-a4b8-41e7-ab43-bd841d101d1c tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:24.200439 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3d59090f-a4b8-41e7-ab43-bd841d101d1c tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:24.200905 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3d59090f-a4b8-41e7-ab43-bd841d101d1c tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:24.201315 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3d59090f-a4b8-41e7-ab43-bd841d101d1c tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:24.362684 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-3d59090f-a4b8-41e7-ab43-bd841d101d1c tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b850cd7b216d4aab865886d20194f322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ebe25211ee4dcb887de8e0c9a03040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:24.374268 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-3d59090f-a4b8-41e7-ab43-bd841d101d1c tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a" status: 200 len: 1357 microversion: 2.1 time: 0.185048 Sep 16 09:55:24.374268 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 332/665] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:24 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a => generated 1357 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:55:24.886353 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-ae3d73b9-e6ca-4f44-817e-26baa82214eb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:24.886989 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-ae3d73b9-e6ca-4f44-817e-26baa82214eb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:24.894278 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ae3d73b9-e6ca-4f44-817e-26baa82214eb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:24.894765 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ae3d73b9-e6ca-4f44-817e-26baa82214eb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:24.895203 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ae3d73b9-e6ca-4f44-817e-26baa82214eb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:24.895896 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ae3d73b9-e6ca-4f44-817e-26baa82214eb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:24.896359 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ae3d73b9-e6ca-4f44-817e-26baa82214eb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:24.896784 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ae3d73b9-e6ca-4f44-817e-26baa82214eb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:25.038245 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-ae3d73b9-e6ca-4f44-817e-26baa82214eb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:25.047018 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-ae3d73b9-e6ca-4f44-817e-26baa82214eb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:25.048454 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-ae3d73b9-e6ca-4f44-817e-26baa82214eb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:25.049813 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-ae3d73b9-e6ca-4f44-817e-26baa82214eb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1406 microversion: 2.20 time: 0.167369 Sep 16 09:55:25.050406 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 334/666] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:55:24 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:55:25.395262 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-627f54a6-93a1-4445-b0a6-a5e73798fff2 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:25.396669 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-627f54a6-93a1-4445-b0a6-a5e73798fff2 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:25.405102 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-627f54a6-93a1-4445-b0a6-a5e73798fff2 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:25.410240 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-627f54a6-93a1-4445-b0a6-a5e73798fff2 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:25.410921 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-627f54a6-93a1-4445-b0a6-a5e73798fff2 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:25.411806 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-627f54a6-93a1-4445-b0a6-a5e73798fff2 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:25.412403 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-627f54a6-93a1-4445-b0a6-a5e73798fff2 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:25.412969 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-627f54a6-93a1-4445-b0a6-a5e73798fff2 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:25.553502 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-627f54a6-93a1-4445-b0a6-a5e73798fff2 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b850cd7b216d4aab865886d20194f322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ebe25211ee4dcb887de8e0c9a03040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:25.561836 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-627f54a6-93a1-4445-b0a6-a5e73798fff2 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a" status: 200 len: 1357 microversion: 2.1 time: 0.170291 Sep 16 09:55:25.564955 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 333/667] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:25 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:55:26.076115 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-ec0d2212-b578-434e-ac80-6510091d45ae tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:26.076892 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-ec0d2212-b578-434e-ac80-6510091d45ae tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:26.084395 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ec0d2212-b578-434e-ac80-6510091d45ae tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:26.084894 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ec0d2212-b578-434e-ac80-6510091d45ae tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:26.085338 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ec0d2212-b578-434e-ac80-6510091d45ae tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:26.086081 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ec0d2212-b578-434e-ac80-6510091d45ae tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:26.086663 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ec0d2212-b578-434e-ac80-6510091d45ae tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:26.087433 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ec0d2212-b578-434e-ac80-6510091d45ae tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:26.223761 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-ec0d2212-b578-434e-ac80-6510091d45ae tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:26.232050 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-ec0d2212-b578-434e-ac80-6510091d45ae tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:26.233499 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-ec0d2212-b578-434e-ac80-6510091d45ae tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:26.234669 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-ec0d2212-b578-434e-ac80-6510091d45ae tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1406 microversion: 2.20 time: 0.162742 Sep 16 09:55:26.235218 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 335/668] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:55:26 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:55:26.586668 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-7614e029-5d58-4aae-97a2-7401c7e55077 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:26.587294 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-7614e029-5d58-4aae-97a2-7401c7e55077 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:26.594100 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7614e029-5d58-4aae-97a2-7401c7e55077 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:26.594954 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7614e029-5d58-4aae-97a2-7401c7e55077 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:26.595409 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7614e029-5d58-4aae-97a2-7401c7e55077 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:26.596115 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7614e029-5d58-4aae-97a2-7401c7e55077 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:26.596578 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7614e029-5d58-4aae-97a2-7401c7e55077 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:26.597009 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7614e029-5d58-4aae-97a2-7401c7e55077 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:26.680679 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-bfd69e72-9d9b-4b5b-968b-2d1973eec2e9 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:26.681805 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-bfd69e72-9d9b-4b5b-968b-2d1973eec2e9 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] [instance: 5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:26.690476 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bfd69e72-9d9b-4b5b-968b-2d1973eec2e9 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:26.691490 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bfd69e72-9d9b-4b5b-968b-2d1973eec2e9 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:26.692155 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bfd69e72-9d9b-4b5b-968b-2d1973eec2e9 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:26.693301 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bfd69e72-9d9b-4b5b-968b-2d1973eec2e9 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:26.694196 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bfd69e72-9d9b-4b5b-968b-2d1973eec2e9 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:26.694860 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bfd69e72-9d9b-4b5b-968b-2d1973eec2e9 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:26.766562 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-7614e029-5d58-4aae-97a2-7401c7e55077 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b850cd7b216d4aab865886d20194f322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ebe25211ee4dcb887de8e0c9a03040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:26.772884 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-7614e029-5d58-4aae-97a2-7401c7e55077 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a" status: 200 len: 1357 microversion: 2.1 time: 0.190173 Sep 16 09:55:26.773927 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 334/669] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:26 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a => generated 1357 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:55:26.783011 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.objects.instance [None req-bfd69e72-9d9b-4b5b-968b-2d1973eec2e9 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lazy-loading 'services' on Instance uuid 5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32 {{(pid=127670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 09:55:26.959502 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-bfd69e72-9d9b-4b5b-968b-2d1973eec2e9 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] 10.222.0.73 "DELETE /compute/v2.1/servers/5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32/os-volume_attachments/3dc7ce33-cfdc-4712-bd4c-b513a1a70bfc" status: 202 len: 0 microversion: 2.1 time: 0.283867 Sep 16 09:55:26.960144 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 336/670] 10.222.0.73 () {58 vars in 1416 bytes} [Fri Sep 16 09:55:26 2022] DELETE /compute/v2.1/servers/5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32/os-volume_attachments/3dc7ce33-cfdc-4712-bd4c-b513a1a70bfc => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 09:55:27.259904 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-dc927c9a-1fda-463d-88e7-34c837c2bf24 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:27.260554 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-dc927c9a-1fda-463d-88e7-34c837c2bf24 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:27.267314 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-dc927c9a-1fda-463d-88e7-34c837c2bf24 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:27.270537 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-dc927c9a-1fda-463d-88e7-34c837c2bf24 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:27.270537 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-dc927c9a-1fda-463d-88e7-34c837c2bf24 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:27.270537 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-dc927c9a-1fda-463d-88e7-34c837c2bf24 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:27.270537 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-dc927c9a-1fda-463d-88e7-34c837c2bf24 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:27.270927 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-dc927c9a-1fda-463d-88e7-34c837c2bf24 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:27.569909 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-dc927c9a-1fda-463d-88e7-34c837c2bf24 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:27.579316 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-dc927c9a-1fda-463d-88e7-34c837c2bf24 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:27.580760 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-dc927c9a-1fda-463d-88e7-34c837c2bf24 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:27.581934 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-dc927c9a-1fda-463d-88e7-34c837c2bf24 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1406 microversion: 2.20 time: 0.326091 Sep 16 09:55:27.582493 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 335/671] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:55:27 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1406 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:55:27.799582 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-92f381f6-bc83-47ed-a3aa-92e57a932325 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:27.800215 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-92f381f6-bc83-47ed-a3aa-92e57a932325 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:27.806421 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-92f381f6-bc83-47ed-a3aa-92e57a932325 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:27.806921 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-92f381f6-bc83-47ed-a3aa-92e57a932325 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:27.807351 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-92f381f6-bc83-47ed-a3aa-92e57a932325 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:27.808052 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-92f381f6-bc83-47ed-a3aa-92e57a932325 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:27.808514 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-92f381f6-bc83-47ed-a3aa-92e57a932325 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:27.808949 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-92f381f6-bc83-47ed-a3aa-92e57a932325 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:28.006165 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-92f381f6-bc83-47ed-a3aa-92e57a932325 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b850cd7b216d4aab865886d20194f322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ebe25211ee4dcb887de8e0c9a03040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:28.013819 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-92f381f6-bc83-47ed-a3aa-92e57a932325 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a" status: 200 len: 1357 microversion: 2.1 time: 0.219943 Sep 16 09:55:28.014378 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 337/672] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:27 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a => generated 1357 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:55:28.607528 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-896121d8-831b-4095-a831-7a3a7c413f09 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:28.608080 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-896121d8-831b-4095-a831-7a3a7c413f09 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:28.615441 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-896121d8-831b-4095-a831-7a3a7c413f09 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:28.615934 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-896121d8-831b-4095-a831-7a3a7c413f09 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:28.616413 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-896121d8-831b-4095-a831-7a3a7c413f09 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:28.617134 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-896121d8-831b-4095-a831-7a3a7c413f09 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:28.617622 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-896121d8-831b-4095-a831-7a3a7c413f09 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:28.618053 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-896121d8-831b-4095-a831-7a3a7c413f09 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:28.751985 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-896121d8-831b-4095-a831-7a3a7c413f09 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:28.760050 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-896121d8-831b-4095-a831-7a3a7c413f09 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:28.761526 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-896121d8-831b-4095-a831-7a3a7c413f09 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:28.762685 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-896121d8-831b-4095-a831-7a3a7c413f09 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1406 microversion: 2.20 time: 0.159463 Sep 16 09:55:28.763242 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 336/673] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:55:28 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:55:29.037695 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-102850a8-86d4-4307-adfe-7e644757d12c tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:29.038320 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-102850a8-86d4-4307-adfe-7e644757d12c tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:29.055809 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-102850a8-86d4-4307-adfe-7e644757d12c tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:29.056348 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-102850a8-86d4-4307-adfe-7e644757d12c tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:29.056815 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-102850a8-86d4-4307-adfe-7e644757d12c tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:29.057520 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-102850a8-86d4-4307-adfe-7e644757d12c tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:29.058009 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-102850a8-86d4-4307-adfe-7e644757d12c tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:29.074821 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-102850a8-86d4-4307-adfe-7e644757d12c tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:29.348424 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-102850a8-86d4-4307-adfe-7e644757d12c tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b850cd7b216d4aab865886d20194f322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ebe25211ee4dcb887de8e0c9a03040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:29.356411 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-102850a8-86d4-4307-adfe-7e644757d12c tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a" status: 200 len: 1357 microversion: 2.1 time: 0.323212 Sep 16 09:55:29.357393 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 338/674] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:29 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a => generated 1357 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:55:29.788036 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-32c011de-7606-4a9d-baa8-b4ddcff4c088 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:29.788671 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-32c011de-7606-4a9d-baa8-b4ddcff4c088 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:29.796244 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-32c011de-7606-4a9d-baa8-b4ddcff4c088 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:29.797427 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-32c011de-7606-4a9d-baa8-b4ddcff4c088 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:29.797916 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-32c011de-7606-4a9d-baa8-b4ddcff4c088 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:29.798653 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-32c011de-7606-4a9d-baa8-b4ddcff4c088 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:29.799278 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-32c011de-7606-4a9d-baa8-b4ddcff4c088 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:29.799723 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-32c011de-7606-4a9d-baa8-b4ddcff4c088 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:30.021410 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-32c011de-7606-4a9d-baa8-b4ddcff4c088 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:30.032806 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-32c011de-7606-4a9d-baa8-b4ddcff4c088 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:30.035164 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-32c011de-7606-4a9d-baa8-b4ddcff4c088 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:30.036460 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-32c011de-7606-4a9d-baa8-b4ddcff4c088 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1406 microversion: 2.20 time: 0.252715 Sep 16 09:55:30.037503 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 337/675] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:55:29 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1406 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:55:30.225007 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-710d12eb-d321-4760-9155-7334b770afb7 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:30.225643 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-710d12eb-d321-4760-9155-7334b770afb7 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] [instance: 5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:30.232743 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-710d12eb-d321-4760-9155-7334b770afb7 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:30.233613 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-710d12eb-d321-4760-9155-7334b770afb7 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:30.234180 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-710d12eb-d321-4760-9155-7334b770afb7 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:30.234972 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-710d12eb-d321-4760-9155-7334b770afb7 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:30.235499 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-710d12eb-d321-4760-9155-7334b770afb7 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:30.236005 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-710d12eb-d321-4760-9155-7334b770afb7 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:30.261826 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-710d12eb-d321-4760-9155-7334b770afb7 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] [instance: 5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32] Going to try to terminate instance {{(pid=127670) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 09:55:30.379787 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-64331ac3-8f8a-449d-b0e5-38f61f1774de tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:30.380321 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-64331ac3-8f8a-449d-b0e5-38f61f1774de tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:30.386410 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-64331ac3-8f8a-449d-b0e5-38f61f1774de tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:30.386884 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-64331ac3-8f8a-449d-b0e5-38f61f1774de tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:30.387314 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-64331ac3-8f8a-449d-b0e5-38f61f1774de tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:30.387991 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-64331ac3-8f8a-449d-b0e5-38f61f1774de tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:30.388441 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-64331ac3-8f8a-449d-b0e5-38f61f1774de tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:30.388859 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-64331ac3-8f8a-449d-b0e5-38f61f1774de tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:30.522968 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-64331ac3-8f8a-449d-b0e5-38f61f1774de tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b850cd7b216d4aab865886d20194f322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ebe25211ee4dcb887de8e0c9a03040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:30.530823 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-64331ac3-8f8a-449d-b0e5-38f61f1774de tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a" status: 200 len: 1357 microversion: 2.1 time: 0.154861 Sep 16 09:55:30.531452 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 338/676] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:30 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:55:30.535883 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [req-81471461-6201-4134-a30c-00d31ca9f7e2 req-3017c48b-dcb2-4943-b881-e45aa94584c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a74942a9-2ed1-4058-b2f6-6def2204784a", "tag": "dedee03b-d367-4e51-b2cd-813deda5dc38"}]} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:55:30.544824 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-81471461-6201-4134-a30c-00d31ca9f7e2 req-3017c48b-dcb2-4943-b881-e45aa94584c9 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:30.545300 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-81471461-6201-4134-a30c-00d31ca9f7e2 req-3017c48b-dcb2-4943-b881-e45aa94584c9 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:30.545793 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-81471461-6201-4134-a30c-00d31ca9f7e2 req-3017c48b-dcb2-4943-b881-e45aa94584c9 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:30.557890 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.compute.server_external_events [req-81471461-6201-4134-a30c-00d31ca9f7e2 req-3017c48b-dcb2-4943-b881-e45aa94584c9 service nova] Creating event network-changed:dedee03b-d367-4e51-b2cd-813deda5dc38 for instance a74942a9-2ed1-4058-b2f6-6def2204784a on hv-cinder-79053 Sep 16 09:55:30.563439 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [req-81471461-6201-4134-a30c-00d31ca9f7e2 req-3017c48b-dcb2-4943-b881-e45aa94584c9 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030872 Sep 16 09:55:30.564013 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 339/677] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:55:30.577301 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-710d12eb-d321-4760-9155-7334b770afb7 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] 10.222.0.73 "DELETE /compute/v2.1/servers/5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32" status: 204 len: 0 microversion: 2.1 time: 0.356072 Sep 16 09:55:30.578511 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 339/678] 10.222.0.73 () {58 vars in 1239 bytes} [Fri Sep 16 09:55:30 2022] DELETE /compute/v2.1/servers/5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 09:55:30.587252 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-39724218-dfcf-4d3e-aa45-82730aff20d9 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:30.592012 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-39724218-dfcf-4d3e-aa45-82730aff20d9 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] [instance: 5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:30.594522 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-39724218-dfcf-4d3e-aa45-82730aff20d9 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:30.595004 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-39724218-dfcf-4d3e-aa45-82730aff20d9 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:30.595442 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-39724218-dfcf-4d3e-aa45-82730aff20d9 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:30.596129 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-39724218-dfcf-4d3e-aa45-82730aff20d9 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:30.596588 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-39724218-dfcf-4d3e-aa45-82730aff20d9 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:30.597014 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-39724218-dfcf-4d3e-aa45-82730aff20d9 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:30.724605 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-39724218-dfcf-4d3e-aa45-82730aff20d9 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1142f8595de54bfc8f28a5152eaa00d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d2a4f111114064aa5a477177e6d1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:30.732900 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-39724218-dfcf-4d3e-aa45-82730aff20d9 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] 10.222.0.73 "GET /compute/v2.1/servers/5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32" status: 200 len: 1513 microversion: 2.1 time: 0.149990 Sep 16 09:55:30.735190 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 340/679] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:30 2022] GET /compute/v2.1/servers/5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:55:31.062920 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-3037a9fe-f042-4cec-8ddb-91f8570f63ab tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:31.063612 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-3037a9fe-f042-4cec-8ddb-91f8570f63ab tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:31.069399 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3037a9fe-f042-4cec-8ddb-91f8570f63ab tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:31.069918 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3037a9fe-f042-4cec-8ddb-91f8570f63ab tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:31.070354 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3037a9fe-f042-4cec-8ddb-91f8570f63ab tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:31.071036 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3037a9fe-f042-4cec-8ddb-91f8570f63ab tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:31.071492 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3037a9fe-f042-4cec-8ddb-91f8570f63ab tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:31.071915 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3037a9fe-f042-4cec-8ddb-91f8570f63ab tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:31.206185 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-3037a9fe-f042-4cec-8ddb-91f8570f63ab tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:31.214116 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-3037a9fe-f042-4cec-8ddb-91f8570f63ab tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:31.215574 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-3037a9fe-f042-4cec-8ddb-91f8570f63ab tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:31.216677 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-3037a9fe-f042-4cec-8ddb-91f8570f63ab tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1406 microversion: 2.20 time: 0.158064 Sep 16 09:55:31.217238 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 340/680] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:55:31 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:55:31.553629 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-2a3b20df-1fd4-47a0-86c6-95beecf6f17d tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:31.554612 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-2a3b20df-1fd4-47a0-86c6-95beecf6f17d tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:31.561933 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2a3b20df-1fd4-47a0-86c6-95beecf6f17d tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:31.562569 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2a3b20df-1fd4-47a0-86c6-95beecf6f17d tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:31.563019 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2a3b20df-1fd4-47a0-86c6-95beecf6f17d tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:31.563719 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2a3b20df-1fd4-47a0-86c6-95beecf6f17d tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:31.564185 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2a3b20df-1fd4-47a0-86c6-95beecf6f17d tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:31.564617 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2a3b20df-1fd4-47a0-86c6-95beecf6f17d tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:31.582868 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell1:SELECT=100 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:55:31.697088 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-2a3b20df-1fd4-47a0-86c6-95beecf6f17d tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b850cd7b216d4aab865886d20194f322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ebe25211ee4dcb887de8e0c9a03040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:31.705878 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-2a3b20df-1fd4-47a0-86c6-95beecf6f17d tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a" status: 200 len: 1357 microversion: 2.1 time: 0.156204 Sep 16 09:55:31.706458 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 341/681] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:31 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:55:31.757701 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-5633c99d-5a03-4f05-a7bd-677d0eef6bb7 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:31.758309 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-5633c99d-5a03-4f05-a7bd-677d0eef6bb7 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] [instance: 5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:31.765103 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5633c99d-5a03-4f05-a7bd-677d0eef6bb7 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:31.766285 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5633c99d-5a03-4f05-a7bd-677d0eef6bb7 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:31.766627 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5633c99d-5a03-4f05-a7bd-677d0eef6bb7 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:31.767311 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5633c99d-5a03-4f05-a7bd-677d0eef6bb7 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:31.767760 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5633c99d-5a03-4f05-a7bd-677d0eef6bb7 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:31.768177 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5633c99d-5a03-4f05-a7bd-677d0eef6bb7 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:31.896324 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-5633c99d-5a03-4f05-a7bd-677d0eef6bb7 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1142f8595de54bfc8f28a5152eaa00d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d2a4f111114064aa5a477177e6d1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:31.903899 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-5633c99d-5a03-4f05-a7bd-677d0eef6bb7 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] 10.222.0.73 "GET /compute/v2.1/servers/5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32" status: 200 len: 1513 microversion: 2.1 time: 0.151226 Sep 16 09:55:31.904453 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 341/682] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:31 2022] GET /compute/v2.1/servers/5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:55:32.242235 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-5bfdb06b-d9ec-4b21-98ee-54d38f5819e3 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:32.242761 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-5bfdb06b-d9ec-4b21-98ee-54d38f5819e3 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:32.248630 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5bfdb06b-d9ec-4b21-98ee-54d38f5819e3 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:32.249126 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5bfdb06b-d9ec-4b21-98ee-54d38f5819e3 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:32.250224 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5bfdb06b-d9ec-4b21-98ee-54d38f5819e3 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:32.250916 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5bfdb06b-d9ec-4b21-98ee-54d38f5819e3 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:32.251368 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5bfdb06b-d9ec-4b21-98ee-54d38f5819e3 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:32.251787 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5bfdb06b-d9ec-4b21-98ee-54d38f5819e3 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:32.379416 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-5bfdb06b-d9ec-4b21-98ee-54d38f5819e3 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:32.387347 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-5bfdb06b-d9ec-4b21-98ee-54d38f5819e3 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:32.388777 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-5bfdb06b-d9ec-4b21-98ee-54d38f5819e3 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:32.389961 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-5bfdb06b-d9ec-4b21-98ee-54d38f5819e3 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1406 microversion: 2.20 time: 0.151739 Sep 16 09:55:32.390904 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 342/683] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:55:32 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:55:32.728822 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-6d0c8ee9-bc55-437c-bd46-0c44d9aff84b tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:32.729441 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-6d0c8ee9-bc55-437c-bd46-0c44d9aff84b tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:32.736998 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6d0c8ee9-bc55-437c-bd46-0c44d9aff84b tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:32.737489 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6d0c8ee9-bc55-437c-bd46-0c44d9aff84b tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:32.737963 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6d0c8ee9-bc55-437c-bd46-0c44d9aff84b tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:32.738661 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6d0c8ee9-bc55-437c-bd46-0c44d9aff84b tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:32.739124 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6d0c8ee9-bc55-437c-bd46-0c44d9aff84b tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:32.739555 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6d0c8ee9-bc55-437c-bd46-0c44d9aff84b tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:32.927733 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-b7a15843-5de6-4f89-b11e-37ad1be24cb5 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:32.928340 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-b7a15843-5de6-4f89-b11e-37ad1be24cb5 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] [instance: 5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:32.934854 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b7a15843-5de6-4f89-b11e-37ad1be24cb5 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:32.935345 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b7a15843-5de6-4f89-b11e-37ad1be24cb5 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:32.935786 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b7a15843-5de6-4f89-b11e-37ad1be24cb5 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:32.936491 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b7a15843-5de6-4f89-b11e-37ad1be24cb5 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:32.937572 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b7a15843-5de6-4f89-b11e-37ad1be24cb5 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:32.938243 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b7a15843-5de6-4f89-b11e-37ad1be24cb5 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:32.947737 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-6d0c8ee9-bc55-437c-bd46-0c44d9aff84b tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b850cd7b216d4aab865886d20194f322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ebe25211ee4dcb887de8e0c9a03040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:32.955999 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-6d0c8ee9-bc55-437c-bd46-0c44d9aff84b tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a" status: 200 len: 1357 microversion: 2.1 time: 0.231306 Sep 16 09:55:32.966306 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 342/684] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:32 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a => generated 1357 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:55:33.084490 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-b7a15843-5de6-4f89-b11e-37ad1be24cb5 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1142f8595de54bfc8f28a5152eaa00d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d2a4f111114064aa5a477177e6d1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:33.092465 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-b7a15843-5de6-4f89-b11e-37ad1be24cb5 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] 10.222.0.73 "GET /compute/v2.1/servers/5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32" status: 200 len: 1513 microversion: 2.1 time: 0.168628 Sep 16 09:55:33.093192 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 343/685] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:32 2022] GET /compute/v2.1/servers/5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32 => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:55:33.415522 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d702eab9-576e-429a-a882-4c4252523ec5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:33.416148 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-d702eab9-576e-429a-a882-4c4252523ec5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:33.423293 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d702eab9-576e-429a-a882-4c4252523ec5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:33.423793 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d702eab9-576e-429a-a882-4c4252523ec5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:33.424240 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d702eab9-576e-429a-a882-4c4252523ec5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:33.424949 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d702eab9-576e-429a-a882-4c4252523ec5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:33.425420 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d702eab9-576e-429a-a882-4c4252523ec5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:33.425885 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d702eab9-576e-429a-a882-4c4252523ec5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:33.441650 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:55:33.737658 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-d702eab9-576e-429a-a882-4c4252523ec5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:33.748008 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-d702eab9-576e-429a-a882-4c4252523ec5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:33.749503 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-d702eab9-576e-429a-a882-4c4252523ec5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:33.750844 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-d702eab9-576e-429a-a882-4c4252523ec5 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1406 microversion: 2.20 time: 0.339344 Sep 16 09:55:33.751626 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 343/686] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:55:33 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1406 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:55:33.978868 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-6d94d821-d0d1-435a-bfb6-9c9c90693720 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:33.979526 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-6d94d821-d0d1-435a-bfb6-9c9c90693720 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:33.990604 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6d94d821-d0d1-435a-bfb6-9c9c90693720 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:33.991104 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6d94d821-d0d1-435a-bfb6-9c9c90693720 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:33.991551 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6d94d821-d0d1-435a-bfb6-9c9c90693720 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:33.994106 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6d94d821-d0d1-435a-bfb6-9c9c90693720 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:33.996085 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6d94d821-d0d1-435a-bfb6-9c9c90693720 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:33.996573 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6d94d821-d0d1-435a-bfb6-9c9c90693720 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:34.041655 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-3aadb7af-ea55-4395-b663-281e347b73d0 req-1439e1fa-ef22-402c-b2da-bb6e4cca415f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32", "name": "network-vif-deleted", "tag": "653f531b-38b0-487f-a8d5-e1b3745ae870"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:55:34.052585 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-3aadb7af-ea55-4395-b663-281e347b73d0 req-1439e1fa-ef22-402c-b2da-bb6e4cca415f service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:34.053071 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-3aadb7af-ea55-4395-b663-281e347b73d0 req-1439e1fa-ef22-402c-b2da-bb6e4cca415f service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:34.053503 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-3aadb7af-ea55-4395-b663-281e347b73d0 req-1439e1fa-ef22-402c-b2da-bb6e4cca415f service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:34.067266 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-3aadb7af-ea55-4395-b663-281e347b73d0 req-1439e1fa-ef22-402c-b2da-bb6e4cca415f service nova] Creating event network-vif-deleted:653f531b-38b0-487f-a8d5-e1b3745ae870 for instance 5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32 on hv-cinder-79053 Sep 16 09:55:34.073651 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-3aadb7af-ea55-4395-b663-281e347b73d0 req-1439e1fa-ef22-402c-b2da-bb6e4cca415f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035651 Sep 16 09:55:34.075237 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 344/687] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 09:55:34.117644 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-00acdb90-6dd0-46fc-b5a6-727fde7f111c tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:34.118415 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-00acdb90-6dd0-46fc-b5a6-727fde7f111c tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] [instance: 5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:34.124526 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-00acdb90-6dd0-46fc-b5a6-727fde7f111c tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:34.125664 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-00acdb90-6dd0-46fc-b5a6-727fde7f111c tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:34.126135 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-00acdb90-6dd0-46fc-b5a6-727fde7f111c tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:34.126846 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-00acdb90-6dd0-46fc-b5a6-727fde7f111c tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:34.127311 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-00acdb90-6dd0-46fc-b5a6-727fde7f111c tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:34.127743 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-00acdb90-6dd0-46fc-b5a6-727fde7f111c tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:34.140765 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-6d94d821-d0d1-435a-bfb6-9c9c90693720 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b850cd7b216d4aab865886d20194f322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ebe25211ee4dcb887de8e0c9a03040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:34.148328 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-6d94d821-d0d1-435a-bfb6-9c9c90693720 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a" status: 200 len: 1357 microversion: 2.1 time: 0.173376 Sep 16 09:55:34.148883 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 344/688] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:33 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:55:34.192394 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-00acdb90-6dd0-46fc-b5a6-727fde7f111c tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1142f8595de54bfc8f28a5152eaa00d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d2a4f111114064aa5a477177e6d1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:34.200164 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-00acdb90-6dd0-46fc-b5a6-727fde7f111c tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] 10.222.0.73 "GET /compute/v2.1/servers/5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32" status: 200 len: 1471 microversion: 2.1 time: 0.086647 Sep 16 09:55:34.200677 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 345/689] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:34 2022] GET /compute/v2.1/servers/5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32 => generated 1471 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:55:34.776862 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-20daf9d5-a630-4762-b322-480b3f2fa055 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:34.777474 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-20daf9d5-a630-4762-b322-480b3f2fa055 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:34.783529 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-20daf9d5-a630-4762-b322-480b3f2fa055 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:34.784019 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-20daf9d5-a630-4762-b322-480b3f2fa055 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:34.784458 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-20daf9d5-a630-4762-b322-480b3f2fa055 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:34.785160 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-20daf9d5-a630-4762-b322-480b3f2fa055 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:34.785652 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-20daf9d5-a630-4762-b322-480b3f2fa055 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:34.786079 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-20daf9d5-a630-4762-b322-480b3f2fa055 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:34.915537 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-20daf9d5-a630-4762-b322-480b3f2fa055 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:34.924350 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-20daf9d5-a630-4762-b322-480b3f2fa055 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:34.925840 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-20daf9d5-a630-4762-b322-480b3f2fa055 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:34.926962 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-20daf9d5-a630-4762-b322-480b3f2fa055 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1406 microversion: 2.20 time: 0.154129 Sep 16 09:55:34.927513 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 345/690] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:55:34 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:55:35.172097 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-8a8f8c91-588d-4b18-8627-b72e88098feb tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:35.173577 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-8a8f8c91-588d-4b18-8627-b72e88098feb tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:35.180603 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8a8f8c91-588d-4b18-8627-b72e88098feb tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:35.181101 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8a8f8c91-588d-4b18-8627-b72e88098feb tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:35.181564 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8a8f8c91-588d-4b18-8627-b72e88098feb tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:35.182296 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8a8f8c91-588d-4b18-8627-b72e88098feb tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:35.183413 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8a8f8c91-588d-4b18-8627-b72e88098feb tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:35.184156 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8a8f8c91-588d-4b18-8627-b72e88098feb tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:35.210459 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [req-8ae73842-aeb6-4acb-a5c8-69d7a552253e req-029bde2e-a9a1-4594-b2d2-adb8dfdaf32f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0f4a754-d9db-4829-a2f8-677cc9c34fbc", "name": "network-vif-plugged", "status": "completed", "tag": "789fb3b6-eef8-4edd-a929-e88fed92432d"}]} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:55:35.224889 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-8ae73842-aeb6-4acb-a5c8-69d7a552253e req-029bde2e-a9a1-4594-b2d2-adb8dfdaf32f service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:35.225474 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-8ae73842-aeb6-4acb-a5c8-69d7a552253e req-029bde2e-a9a1-4594-b2d2-adb8dfdaf32f service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:35.226104 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-8ae73842-aeb6-4acb-a5c8-69d7a552253e req-029bde2e-a9a1-4594-b2d2-adb8dfdaf32f service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:35.239237 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.compute.server_external_events [req-8ae73842-aeb6-4acb-a5c8-69d7a552253e req-029bde2e-a9a1-4594-b2d2-adb8dfdaf32f service nova] Creating event network-vif-plugged:789fb3b6-eef8-4edd-a929-e88fed92432d for instance e0f4a754-d9db-4829-a2f8-677cc9c34fbc on hv-cinder-79053 Sep 16 09:55:35.244389 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [req-8ae73842-aeb6-4acb-a5c8-69d7a552253e req-029bde2e-a9a1-4594-b2d2-adb8dfdaf32f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038480 Sep 16 09:55:35.245079 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 346/691] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:55:35.250164 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-ab9abeef-9cd7-415c-9d07-533c9c6bebbc tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:35.251430 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-ab9abeef-9cd7-415c-9d07-533c9c6bebbc tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] [instance: 5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:35.267193 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ab9abeef-9cd7-415c-9d07-533c9c6bebbc tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:35.268438 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ab9abeef-9cd7-415c-9d07-533c9c6bebbc tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:35.268438 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ab9abeef-9cd7-415c-9d07-533c9c6bebbc tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:35.268885 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ab9abeef-9cd7-415c-9d07-533c9c6bebbc tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:35.269339 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ab9abeef-9cd7-415c-9d07-533c9c6bebbc tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:35.270368 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ab9abeef-9cd7-415c-9d07-533c9c6bebbc tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:35.314174 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ab9abeef-9cd7-415c-9d07-533c9c6bebbc tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:35.314776 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ab9abeef-9cd7-415c-9d07-533c9c6bebbc tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:35.315294 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ab9abeef-9cd7-415c-9d07-533c9c6bebbc tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:35.315830 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.objects.instance [None req-ab9abeef-9cd7-415c-9d07-533c9c6bebbc tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lazy-loading 'fault' on Instance uuid 5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32 {{(pid=127671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 09:55:35.337917 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-8a8f8c91-588d-4b18-8627-b72e88098feb tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b850cd7b216d4aab865886d20194f322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ebe25211ee4dcb887de8e0c9a03040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:35.350526 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-8a8f8c91-588d-4b18-8627-b72e88098feb tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a" status: 200 len: 1357 microversion: 2.1 time: 0.182148 Sep 16 09:55:35.366051 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 346/692] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:35 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a => generated 1357 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:55:35.366409 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-ab9abeef-9cd7-415c-9d07-533c9c6bebbc tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1142f8595de54bfc8f28a5152eaa00d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d2a4f111114064aa5a477177e6d1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:35.374468 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-ab9abeef-9cd7-415c-9d07-533c9c6bebbc tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] 10.222.0.73 "GET /compute/v2.1/servers/5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32" status: 200 len: 1309 microversion: 2.1 time: 0.128024 Sep 16 09:55:35.375105 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 347/693] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:35 2022] GET /compute/v2.1/servers/5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32 => generated 1309 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:55:35.952028 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-f0b35808-7560-4ec7-950e-52211d0c9342 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:35.952652 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-f0b35808-7560-4ec7-950e-52211d0c9342 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:35.959199 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f0b35808-7560-4ec7-950e-52211d0c9342 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:35.959695 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f0b35808-7560-4ec7-950e-52211d0c9342 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:35.960141 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f0b35808-7560-4ec7-950e-52211d0c9342 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:35.960843 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f0b35808-7560-4ec7-950e-52211d0c9342 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:35.961302 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f0b35808-7560-4ec7-950e-52211d0c9342 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:35.961850 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f0b35808-7560-4ec7-950e-52211d0c9342 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:36.092404 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f0b35808-7560-4ec7-950e-52211d0c9342 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:36.101132 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f0b35808-7560-4ec7-950e-52211d0c9342 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:36.102601 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f0b35808-7560-4ec7-950e-52211d0c9342 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:36.103702 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-f0b35808-7560-4ec7-950e-52211d0c9342 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1406 microversion: 2.20 time: 0.155492 Sep 16 09:55:36.104260 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 347/694] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:55:35 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:55:36.374837 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-5e9f2f26-b856-41a4-9250-6f12d40ed2a9 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:36.375475 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-5e9f2f26-b856-41a4-9250-6f12d40ed2a9 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:36.382443 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5e9f2f26-b856-41a4-9250-6f12d40ed2a9 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:36.382931 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5e9f2f26-b856-41a4-9250-6f12d40ed2a9 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:36.383373 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5e9f2f26-b856-41a4-9250-6f12d40ed2a9 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:36.384064 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5e9f2f26-b856-41a4-9250-6f12d40ed2a9 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:36.384523 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5e9f2f26-b856-41a4-9250-6f12d40ed2a9 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:36.384952 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5e9f2f26-b856-41a4-9250-6f12d40ed2a9 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:36.398634 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-a693d0d6-0fb7-4b16-adcd-7463542b6443 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:36.399343 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-a693d0d6-0fb7-4b16-adcd-7463542b6443 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] [instance: 5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:36.406058 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a693d0d6-0fb7-4b16-adcd-7463542b6443 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:36.406553 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a693d0d6-0fb7-4b16-adcd-7463542b6443 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:36.406998 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a693d0d6-0fb7-4b16-adcd-7463542b6443 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:36.407704 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a693d0d6-0fb7-4b16-adcd-7463542b6443 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:36.408168 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a693d0d6-0fb7-4b16-adcd-7463542b6443 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:36.408602 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a693d0d6-0fb7-4b16-adcd-7463542b6443 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:36.440330 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a693d0d6-0fb7-4b16-adcd-7463542b6443 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:36.440823 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a693d0d6-0fb7-4b16-adcd-7463542b6443 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:36.441260 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a693d0d6-0fb7-4b16-adcd-7463542b6443 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:36.441740 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.objects.instance [None req-a693d0d6-0fb7-4b16-adcd-7463542b6443 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lazy-loading 'fault' on Instance uuid 5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32 {{(pid=127670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 09:55:36.483447 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-a693d0d6-0fb7-4b16-adcd-7463542b6443 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1142f8595de54bfc8f28a5152eaa00d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d2a4f111114064aa5a477177e6d1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:36.491283 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-a693d0d6-0fb7-4b16-adcd-7463542b6443 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] 10.222.0.73 "GET /compute/v2.1/servers/5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32" status: 200 len: 1309 microversion: 2.1 time: 0.096449 Sep 16 09:55:36.491864 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 348/695] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:36 2022] GET /compute/v2.1/servers/5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32 => generated 1309 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:55:36.514752 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-5e9f2f26-b856-41a4-9250-6f12d40ed2a9 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b850cd7b216d4aab865886d20194f322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ebe25211ee4dcb887de8e0c9a03040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:36.522846 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-5e9f2f26-b856-41a4-9250-6f12d40ed2a9 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a" status: 200 len: 1357 microversion: 2.1 time: 0.151985 Sep 16 09:55:36.523402 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 348/696] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:36 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:55:37.132412 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-3221992a-08b0-4f8a-bccf-99d54db3bb2a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:37.133035 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-3221992a-08b0-4f8a-bccf-99d54db3bb2a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:37.139095 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3221992a-08b0-4f8a-bccf-99d54db3bb2a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:37.139729 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3221992a-08b0-4f8a-bccf-99d54db3bb2a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:37.140331 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3221992a-08b0-4f8a-bccf-99d54db3bb2a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:37.140973 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3221992a-08b0-4f8a-bccf-99d54db3bb2a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:37.141695 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3221992a-08b0-4f8a-bccf-99d54db3bb2a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:37.142100 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3221992a-08b0-4f8a-bccf-99d54db3bb2a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:37.276434 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-3221992a-08b0-4f8a-bccf-99d54db3bb2a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:37.286119 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-3221992a-08b0-4f8a-bccf-99d54db3bb2a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:37.287567 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-3221992a-08b0-4f8a-bccf-99d54db3bb2a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:37.288735 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-3221992a-08b0-4f8a-bccf-99d54db3bb2a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1406 microversion: 2.20 time: 0.160242 Sep 16 09:55:37.289293 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 349/697] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:55:37 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:55:37.515556 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-a4eddc45-dfa6-44e9-b293-ed29bf6f65cb tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:37.516162 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-a4eddc45-dfa6-44e9-b293-ed29bf6f65cb tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] [instance: 5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:37.523633 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a4eddc45-dfa6-44e9-b293-ed29bf6f65cb tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:37.524108 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a4eddc45-dfa6-44e9-b293-ed29bf6f65cb tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:37.524541 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a4eddc45-dfa6-44e9-b293-ed29bf6f65cb tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:37.525227 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a4eddc45-dfa6-44e9-b293-ed29bf6f65cb tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:37.525727 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a4eddc45-dfa6-44e9-b293-ed29bf6f65cb tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:37.526626 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a4eddc45-dfa6-44e9-b293-ed29bf6f65cb tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:37.543784 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.wsgi [None req-a4eddc45-dfa6-44e9-b293-ed29bf6f65cb tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] HTTP exception thrown: Instance 5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32 could not be found. Sep 16 09:55:37.545575 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-a4eddc45-dfa6-44e9-b293-ed29bf6f65cb tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Request method failure captured: Sep 16 09:55:37.545575 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: request: GET /compute/v2.1/servers/5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32 HTTP/1.1 Sep 16 09:55:37.545575 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept: application/json Sep 16 09:55:37.545575 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept-Encoding: identity Sep 16 09:55:37.545575 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Connection: close Sep 16 09:55:37.545575 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Length: 0 Sep 16 09:55:37.545575 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Type: application/json Sep 16 09:55:37.545575 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Host: 10.222.0.73 Sep 16 09:55:37.545575 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Openstack-System-Scope: None Sep 16 09:55:37.545575 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: User-Agent: python-urllib3/1.26.12 Sep 16 09:55:37.545575 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Auth-Token: gAAAAABjJEfNpqKGXwy_iXG64w2PJ1Nx_Taqk-joxDcgOYE1IjGGYxs5meGacmOH-wKhPLyL1AGxm_zSIBjZnp_gJNf0IXhdQcL1V-6xQvwA39L_sjxA0QpLbBN_X2KeNJFk873ssN0PyD9kBoutoQtMDg4gwksmLwdi-4Cl4syEpK4eBz9DYso Sep 16 09:55:37.545575 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Id: None Sep 16 09:55:37.545575 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Name: None Sep 16 09:55:37.545575 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Identity-Status: Confirmed Sep 16 09:55:37.545575 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Is-Admin-Project: True Sep 16 09:55:37.545575 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Id: default Sep 16 09:55:37.545575 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Name: Default Sep 16 09:55:37.545575 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Id: 01d2a4f111114064aa5a477177e6d1dd Sep 16 09:55:37.545575 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1272653757 Sep 16 09:55:37.545575 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Role: reader,member Sep 16 09:55:37.545575 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Roles: reader,member Sep 16 09:55:37.547073 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/01d2a4f111114064aa5a477177e6d1dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_01d2a4f111114064aa5a477177e6d1dd", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/01d2a4f111114064aa5a477177e6d1dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/01d2a4f111114064aa5a477177e6d1dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 09:55:37.547073 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant: tempest-VolumesSnapshotTestJSON-1272653757 Sep 16 09:55:37.547073 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Id: 01d2a4f111114064aa5a477177e6d1dd Sep 16 09:55:37.547073 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1272653757 Sep 16 09:55:37.547073 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User: tempest-VolumesSnapshotTestJSON-1272653757-project Sep 16 09:55:37.547073 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Id: default Sep 16 09:55:37.547073 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Name: Default Sep 16 09:55:37.547073 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Id: 1142f8595de54bfc8f28a5152eaa00d1 Sep 16 09:55:37.547073 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Name: tempest-VolumesSnapshotTestJSON-1272653757-project Sep 16 09:55:37.547073 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: method: > Sep 16 09:55:37.547073 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: exception: Instance 5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32 could not be found. Sep 16 09:55:37.547073 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: action_args: {'id': '5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32'} Sep 16 09:55:37.548074 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 09:55:37.548074 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:55:37.548074 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 09:55:37.548074 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 09:55:37.548074 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 09:55:37.548074 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 09:55:37.548074 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 09:55:37.548074 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 09:55:37.548074 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 09:55:37.548074 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 09:55:37.548074 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32 could not be found. Sep 16 09:55:37.548074 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:55:37.548074 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:55:37.548074 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:55:37.548074 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:55:37.548074 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:55:37.548074 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:55:37.548074 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 09:55:37.548074 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 09:55:37.548074 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 09:55:37.549399 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:55:37.549399 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 09:55:37.549399 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 09:55:37.549399 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 09:55:37.549399 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 09:55:37.549399 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 09:55:37.549399 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 09:55:37.549399 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32 could not be found. Sep 16 09:55:37.549399 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:55:37.549399 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:55:37.549399 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:55:37.549399 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:55:37.549399 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:55:37.549399 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:55:37.549399 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 09:55:37.549399 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 09:55:37.549399 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32 could not be found. Sep 16 09:55:37.549399 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:55:37.550729 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-a4eddc45-dfa6-44e9-b293-ed29bf6f65cb tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Returning 404 to user: Instance 5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32 could not be found. {{(pid=127671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 09:55:37.550808 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-6e0aebfc-0c70-4c83-98a0-a859006643cc tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:37.550808 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-6e0aebfc-0c70-4c83-98a0-a859006643cc tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:37.552244 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-a4eddc45-dfa6-44e9-b293-ed29bf6f65cb tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] 10.222.0.73 "GET /compute/v2.1/servers/5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32" status: 404 len: 111 microversion: 2.1 time: 0.036550 Sep 16 09:55:37.552244 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 349/698] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:37 2022] GET /compute/v2.1/servers/5fb1768d-3b6f-4fa5-9e3f-bbd5a4548e32 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 09:55:37.569880 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6e0aebfc-0c70-4c83-98a0-a859006643cc tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:37.569880 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6e0aebfc-0c70-4c83-98a0-a859006643cc tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:37.569880 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6e0aebfc-0c70-4c83-98a0-a859006643cc tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:37.570452 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6e0aebfc-0c70-4c83-98a0-a859006643cc tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:37.570957 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6e0aebfc-0c70-4c83-98a0-a859006643cc tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:37.571402 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6e0aebfc-0c70-4c83-98a0-a859006643cc tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:37.711211 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-6e0aebfc-0c70-4c83-98a0-a859006643cc tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b850cd7b216d4aab865886d20194f322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ebe25211ee4dcb887de8e0c9a03040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:37.719186 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-6e0aebfc-0c70-4c83-98a0-a859006643cc tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a" status: 200 len: 1357 microversion: 2.1 time: 0.177236 Sep 16 09:55:37.719876 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 350/699] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:37 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a => generated 1357 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:55:38.317462 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-a952ec6d-96f7-42c1-bffb-832872598e01 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:38.318119 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-a952ec6d-96f7-42c1-bffb-832872598e01 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:38.324158 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a952ec6d-96f7-42c1-bffb-832872598e01 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:38.324651 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a952ec6d-96f7-42c1-bffb-832872598e01 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:38.325096 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a952ec6d-96f7-42c1-bffb-832872598e01 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:38.325824 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a952ec6d-96f7-42c1-bffb-832872598e01 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:38.326289 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a952ec6d-96f7-42c1-bffb-832872598e01 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:38.326719 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a952ec6d-96f7-42c1-bffb-832872598e01 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:38.510261 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-a952ec6d-96f7-42c1-bffb-832872598e01 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:38.518378 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-a952ec6d-96f7-42c1-bffb-832872598e01 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:38.519816 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-a952ec6d-96f7-42c1-bffb-832872598e01 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:38.520964 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-a952ec6d-96f7-42c1-bffb-832872598e01 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1599 microversion: 2.20 time: 0.208623 Sep 16 09:55:38.521514 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 350/700] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:55:38 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1599 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:55:38.545786 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-c2a4e19f-0109-4a31-9d15-bfd9d76795c1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:38.546286 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-c2a4e19f-0109-4a31-9d15-bfd9d76795c1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:38.552876 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c2a4e19f-0109-4a31-9d15-bfd9d76795c1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:38.553409 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c2a4e19f-0109-4a31-9d15-bfd9d76795c1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:38.553828 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c2a4e19f-0109-4a31-9d15-bfd9d76795c1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:38.554524 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c2a4e19f-0109-4a31-9d15-bfd9d76795c1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:38.554986 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c2a4e19f-0109-4a31-9d15-bfd9d76795c1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:38.555410 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c2a4e19f-0109-4a31-9d15-bfd9d76795c1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:38.633779 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-c2a4e19f-0109-4a31-9d15-bfd9d76795c1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.091884 Sep 16 09:55:38.634376 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 351/701] 10.222.0.73 () {60 vars in 1316 bytes} [Fri Sep 16 09:55:38 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 09:55:38.743529 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-63f43abd-5d36-4e05-a8ba-6da85312359f tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:38.744152 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-63f43abd-5d36-4e05-a8ba-6da85312359f tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:38.750974 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-63f43abd-5d36-4e05-a8ba-6da85312359f tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:38.751592 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-63f43abd-5d36-4e05-a8ba-6da85312359f tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:38.757004 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-63f43abd-5d36-4e05-a8ba-6da85312359f tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:38.757004 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-63f43abd-5d36-4e05-a8ba-6da85312359f tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:38.757004 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-63f43abd-5d36-4e05-a8ba-6da85312359f tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:38.757004 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-63f43abd-5d36-4e05-a8ba-6da85312359f tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:38.883725 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-63f43abd-5d36-4e05-a8ba-6da85312359f tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b850cd7b216d4aab865886d20194f322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ebe25211ee4dcb887de8e0c9a03040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:38.891435 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-63f43abd-5d36-4e05-a8ba-6da85312359f tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a" status: 200 len: 1357 microversion: 2.1 time: 0.152035 Sep 16 09:55:38.892002 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 351/702] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:38 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:55:39.625607 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-c435c74e-ff7b-46ae-89a7-e44e218a7526 req-8e3291f4-ca2c-4e39-9d60-caa588482e0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0f4a754-d9db-4829-a2f8-677cc9c34fbc", "tag": "789fb3b6-eef8-4edd-a929-e88fed92432d"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:55:39.636014 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-c435c74e-ff7b-46ae-89a7-e44e218a7526 req-8e3291f4-ca2c-4e39-9d60-caa588482e0a service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:39.636587 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-c435c74e-ff7b-46ae-89a7-e44e218a7526 req-8e3291f4-ca2c-4e39-9d60-caa588482e0a service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:39.637102 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-c435c74e-ff7b-46ae-89a7-e44e218a7526 req-8e3291f4-ca2c-4e39-9d60-caa588482e0a service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:39.648804 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-c435c74e-ff7b-46ae-89a7-e44e218a7526 req-8e3291f4-ca2c-4e39-9d60-caa588482e0a service nova] Creating event network-changed:789fb3b6-eef8-4edd-a929-e88fed92432d for instance e0f4a754-d9db-4829-a2f8-677cc9c34fbc on hv-cinder-79053 Sep 16 09:55:39.653689 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-c435c74e-ff7b-46ae-89a7-e44e218a7526 req-8e3291f4-ca2c-4e39-9d60-caa588482e0a service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032475 Sep 16 09:55:39.654289 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 352/703] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:55:39.913725 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-68803e57-f25a-47b5-b925-426fef81a64a tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:39.914345 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-68803e57-f25a-47b5-b925-426fef81a64a tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:39.920456 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-68803e57-f25a-47b5-b925-426fef81a64a tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:39.920941 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-68803e57-f25a-47b5-b925-426fef81a64a tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:39.921377 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-68803e57-f25a-47b5-b925-426fef81a64a tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:39.922098 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-68803e57-f25a-47b5-b925-426fef81a64a tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:39.922557 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-68803e57-f25a-47b5-b925-426fef81a64a tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:39.922985 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-68803e57-f25a-47b5-b925-426fef81a64a tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:40.058315 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-68803e57-f25a-47b5-b925-426fef81a64a tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b850cd7b216d4aab865886d20194f322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ebe25211ee4dcb887de8e0c9a03040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:40.066065 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-68803e57-f25a-47b5-b925-426fef81a64a tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a" status: 200 len: 1357 microversion: 2.1 time: 0.156143 Sep 16 09:55:40.066633 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 352/704] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:39 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:55:41.091096 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-fa3ee69b-d96c-4105-b001-78a6e976a865 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:41.092127 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-fa3ee69b-d96c-4105-b001-78a6e976a865 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:41.101575 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fa3ee69b-d96c-4105-b001-78a6e976a865 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:41.102210 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fa3ee69b-d96c-4105-b001-78a6e976a865 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:41.102749 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fa3ee69b-d96c-4105-b001-78a6e976a865 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:41.103755 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fa3ee69b-d96c-4105-b001-78a6e976a865 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:41.104495 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fa3ee69b-d96c-4105-b001-78a6e976a865 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:41.105015 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fa3ee69b-d96c-4105-b001-78a6e976a865 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:41.140916 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [req-fd2e5e46-5483-4cc8-b216-cc22cc92d534 req-26d4c71b-c4d6-4891-a9bb-46de68ad9b68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a74942a9-2ed1-4058-b2f6-6def2204784a", "name": "network-vif-plugged", "status": "completed", "tag": "dedee03b-d367-4e51-b2cd-813deda5dc38"}]} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:55:41.154624 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-fd2e5e46-5483-4cc8-b216-cc22cc92d534 req-26d4c71b-c4d6-4891-a9bb-46de68ad9b68 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:41.155198 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-fd2e5e46-5483-4cc8-b216-cc22cc92d534 req-26d4c71b-c4d6-4891-a9bb-46de68ad9b68 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:41.155703 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-fd2e5e46-5483-4cc8-b216-cc22cc92d534 req-26d4c71b-c4d6-4891-a9bb-46de68ad9b68 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:41.169112 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.compute.server_external_events [req-fd2e5e46-5483-4cc8-b216-cc22cc92d534 req-26d4c71b-c4d6-4891-a9bb-46de68ad9b68 service nova] Creating event network-vif-plugged:dedee03b-d367-4e51-b2cd-813deda5dc38 for instance a74942a9-2ed1-4058-b2f6-6def2204784a on hv-cinder-79053 Sep 16 09:55:41.174656 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [req-fd2e5e46-5483-4cc8-b216-cc22cc92d534 req-26d4c71b-c4d6-4891-a9bb-46de68ad9b68 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037173 Sep 16 09:55:41.175269 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 353/705] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 09:55:41.352849 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-2d6648f6-85ff-444a-bcce-06a55d5af031 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:41.353928 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-2d6648f6-85ff-444a-bcce-06a55d5af031 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: db7a1d44-25f8-48e4-a8b6-f6ea14a508cb] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:41.362073 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2d6648f6-85ff-444a-bcce-06a55d5af031 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:41.362073 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2d6648f6-85ff-444a-bcce-06a55d5af031 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:41.363609 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2d6648f6-85ff-444a-bcce-06a55d5af031 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:41.363609 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2d6648f6-85ff-444a-bcce-06a55d5af031 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:41.363609 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2d6648f6-85ff-444a-bcce-06a55d5af031 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:41.364013 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2d6648f6-85ff-444a-bcce-06a55d5af031 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:41.388790 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-2d6648f6-85ff-444a-bcce-06a55d5af031 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb/ips" status: 200 len: 150 microversion: 2.1 time: 0.040288 Sep 16 09:55:41.397434 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 354/706] 10.222.0.73 () {58 vars in 1248 bytes} [Fri Sep 16 09:55:41 2022] GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 09:55:41.442196 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-fa3ee69b-d96c-4105-b001-78a6e976a865 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b850cd7b216d4aab865886d20194f322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ebe25211ee4dcb887de8e0c9a03040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:41.460041 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-fa3ee69b-d96c-4105-b001-78a6e976a865 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a" status: 200 len: 1357 microversion: 2.1 time: 0.374395 Sep 16 09:55:41.460884 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 353/707] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:41 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a => generated 1357 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:55:42.483392 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-b65f8780-c562-4a95-8cac-b152950cd61a tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:42.484043 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-b65f8780-c562-4a95-8cac-b152950cd61a tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:42.490928 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b65f8780-c562-4a95-8cac-b152950cd61a tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:42.491413 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b65f8780-c562-4a95-8cac-b152950cd61a tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:42.491916 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b65f8780-c562-4a95-8cac-b152950cd61a tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:42.492636 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b65f8780-c562-4a95-8cac-b152950cd61a tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:42.493180 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b65f8780-c562-4a95-8cac-b152950cd61a tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:42.493634 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b65f8780-c562-4a95-8cac-b152950cd61a tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:42.626264 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-b65f8780-c562-4a95-8cac-b152950cd61a tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b850cd7b216d4aab865886d20194f322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ebe25211ee4dcb887de8e0c9a03040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:42.634747 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-b65f8780-c562-4a95-8cac-b152950cd61a tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a" status: 200 len: 1357 microversion: 2.1 time: 0.155675 Sep 16 09:55:42.635313 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 355/708] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:42 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:55:43.178863 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-adc9d47d-b388-436d-ace3-c55d9d38242c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d7017f7-c1b2-4632-a142-bfb53466b5d0"}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:55:43.181210 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-adc9d47d-b388-436d-ace3-c55d9d38242c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: db7a1d44-25f8-48e4-a8b6-f6ea14a508cb] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:43.183881 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:55:43.188502 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-adc9d47d-b388-436d-ace3-c55d9d38242c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:43.188984 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-adc9d47d-b388-436d-ace3-c55d9d38242c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:43.189606 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-adc9d47d-b388-436d-ace3-c55d9d38242c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:43.190330 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-adc9d47d-b388-436d-ace3-c55d9d38242c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:43.190786 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-adc9d47d-b388-436d-ace3-c55d9d38242c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:43.191262 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-adc9d47d-b388-436d-ace3-c55d9d38242c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:43.659034 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-f3a42096-29b0-4297-8026-e041d56ee4b4 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:43.659658 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-f3a42096-29b0-4297-8026-e041d56ee4b4 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:43.666090 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f3a42096-29b0-4297-8026-e041d56ee4b4 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:43.666588 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f3a42096-29b0-4297-8026-e041d56ee4b4 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:43.666986 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f3a42096-29b0-4297-8026-e041d56ee4b4 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:43.667673 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f3a42096-29b0-4297-8026-e041d56ee4b4 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:43.668125 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f3a42096-29b0-4297-8026-e041d56ee4b4 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:43.668547 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f3a42096-29b0-4297-8026-e041d56ee4b4 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:43.810363 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-f3a42096-29b0-4297-8026-e041d56ee4b4 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b850cd7b216d4aab865886d20194f322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ebe25211ee4dcb887de8e0c9a03040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:43.818270 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-f3a42096-29b0-4297-8026-e041d56ee4b4 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a" status: 200 len: 1547 microversion: 2.1 time: 0.163996 Sep 16 09:55:43.818829 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 356/709] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:43 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a => generated 1547 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:55:43.840233 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-cd0fa3ea-b931-4811-8252-93119db49d8a tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:43.843878 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-cd0fa3ea-b931-4811-8252-93119db49d8a tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:43.847511 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-cd0fa3ea-b931-4811-8252-93119db49d8a tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:43.848001 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-cd0fa3ea-b931-4811-8252-93119db49d8a tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:43.848442 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-cd0fa3ea-b931-4811-8252-93119db49d8a tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:43.849188 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-cd0fa3ea-b931-4811-8252-93119db49d8a tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:43.849708 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-cd0fa3ea-b931-4811-8252-93119db49d8a tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:43.850137 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-cd0fa3ea-b931-4811-8252-93119db49d8a tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:43.940945 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-adc9d47d-b388-436d-ace3-c55d9d38242c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "POST /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.765926 Sep 16 09:55:43.941757 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 354/710] 10.222.0.73 () {60 vars in 1323 bytes} [Fri Sep 16 09:55:43 2022] POST /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb/os-volume_attachments => generated 194 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:55:43.989014 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-cd0fa3ea-b931-4811-8252-93119db49d8a tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b850cd7b216d4aab865886d20194f322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ebe25211ee4dcb887de8e0c9a03040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:43.998602 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-cd0fa3ea-b931-4811-8252-93119db49d8a tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a" status: 200 len: 1547 microversion: 2.1 time: 0.162011 Sep 16 09:55:43.999113 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 357/711] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:43 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a => generated 1547 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:55:44.021385 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-57c62081-6b41-4eb7-a556-d8efe240b177 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:44.026348 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-57c62081-6b41-4eb7-a556-d8efe240b177 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b850cd7b216d4aab865886d20194f322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ebe25211ee4dcb887de8e0c9a03040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:44.027085 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-57c62081-6b41-4eb7-a556-d8efe240b177 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Searching by: {'deleted': False, 'project_id': 'c3ebe25211ee4dcb887de8e0c9a03040'} {{(pid=127670) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 09:55:44.034742 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-57c62081-6b41-4eb7-a556-d8efe240b177 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:44.035011 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-57c62081-6b41-4eb7-a556-d8efe240b177 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:44.035447 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-57c62081-6b41-4eb7-a556-d8efe240b177 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:44.036176 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-57c62081-6b41-4eb7-a556-d8efe240b177 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:44.036629 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-57c62081-6b41-4eb7-a556-d8efe240b177 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:44.037049 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-57c62081-6b41-4eb7-a556-d8efe240b177 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:44.130940 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.multi_cell_list [None req-57c62081-6b41-4eb7-a556-d8efe240b177 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127670) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 16 09:55:44.229950 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-57c62081-6b41-4eb7-a556-d8efe240b177 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.213644 Sep 16 09:55:44.230916 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 355/712] 10.222.0.73 () {58 vars in 1125 bytes} [Fri Sep 16 09:55:44 2022] GET /compute/v2.1/servers => generated 342 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 09:55:44.242573 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-759b28eb-1014-4ed6-b6ad-db384991268e tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:44.243193 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-759b28eb-1014-4ed6-b6ad-db384991268e tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:44.249126 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-759b28eb-1014-4ed6-b6ad-db384991268e tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:44.249595 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-759b28eb-1014-4ed6-b6ad-db384991268e tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:44.250040 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-759b28eb-1014-4ed6-b6ad-db384991268e tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:44.250734 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-759b28eb-1014-4ed6-b6ad-db384991268e tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:44.251311 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-759b28eb-1014-4ed6-b6ad-db384991268e tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:44.252007 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-759b28eb-1014-4ed6-b6ad-db384991268e tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:44.378817 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-759b28eb-1014-4ed6-b6ad-db384991268e tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b850cd7b216d4aab865886d20194f322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ebe25211ee4dcb887de8e0c9a03040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:44.386502 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-759b28eb-1014-4ed6-b6ad-db384991268e tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a" status: 200 len: 1547 microversion: 2.1 time: 0.147712 Sep 16 09:55:44.387073 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 358/713] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:44 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a => generated 1547 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:55:47.200916 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-0b8e9cdf-f942-443d-947c-92a6a746f66a tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-88004527", "imageRef": "30d28050-ec9d-4227-9bb0-5247430f6177", "flavorRef": "452", "networks": [{"uuid": "80ad130f-ee94-4395-b6b0-46a52c3f8f24"}]}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:55:47.259072 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.network.neutron [None req-0b8e9cdf-f942-443d-947c-92a6a746f66a tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] validate_networks() for [('80ad130f-ee94-4395-b6b0-46a52c3f8f24', None, None, None, None, None)] {{(pid=127670) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 09:55:47.441208 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-5ae21ae0-ae38-4aa1-978f-385cf64651b0 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed559bbe-10eb-441e-99fd-133587afff02"}} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:55:47.443779 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-5ae21ae0-ae38-4aa1-978f-385cf64651b0 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:47.451879 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5ae21ae0-ae38-4aa1-978f-385cf64651b0 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:47.452372 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5ae21ae0-ae38-4aa1-978f-385cf64651b0 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:47.452813 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5ae21ae0-ae38-4aa1-978f-385cf64651b0 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:47.453516 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5ae21ae0-ae38-4aa1-978f-385cf64651b0 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:47.454005 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5ae21ae0-ae38-4aa1-978f-385cf64651b0 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:47.455546 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5ae21ae0-ae38-4aa1-978f-385cf64651b0 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:47.651097 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:55:47.670104 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-0b8e9cdf-f942-443d-947c-92a6a746f66a tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Flavor limits 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 09:55:47.670579 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-0b8e9cdf-f942-443d-947c-92a6a746f66a tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Image limits 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 09:55:47.671065 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-0b8e9cdf-f942-443d-947c-92a6a746f66a tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Flavor pref 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 09:55:47.671522 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-0b8e9cdf-f942-443d-947c-92a6a746f66a tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Image pref 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 09:55:47.671937 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-0b8e9cdf-f942-443d-947c-92a6a746f66a tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 09:55:47.680734 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0b8e9cdf-f942-443d-947c-92a6a746f66a tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:47.681212 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0b8e9cdf-f942-443d-947c-92a6a746f66a tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:47.681694 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0b8e9cdf-f942-443d-947c-92a6a746f66a tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:47.682410 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0b8e9cdf-f942-443d-947c-92a6a746f66a tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:47.682888 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0b8e9cdf-f942-443d-947c-92a6a746f66a tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:47.683308 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0b8e9cdf-f942-443d-947c-92a6a746f66a tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:47.700613 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-0b8e9cdf-f942-443d-947c-92a6a746f66a tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Getting quotas for project 01d2a4f111114064aa5a477177e6d1dd. Resources: {'instances', 'cores', 'ram'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 09:55:47.705934 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-0b8e9cdf-f942-443d-947c-92a6a746f66a tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Getting quotas for user 1142f8595de54bfc8f28a5152eaa00d1 and project 01d2a4f111114064aa5a477177e6d1dd. Resources: {'instances', 'cores', 'ram'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 09:55:47.717169 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-0b8e9cdf-f942-443d-947c-92a6a746f66a tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Going to run 1 instances... {{(pid=127670) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 09:55:47.719620 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-0b8e9cdf-f942-443d-947c-92a6a746f66a tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] [instance: 8d0bc242-3744-4992-b1e3-819d84c53e50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='30d28050-ec9d-4227-9bb0-5247430f6177',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 09:55:47.920457 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0b8e9cdf-f942-443d-947c-92a6a746f66a tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] [32a00f80-291a-45d9-9520-43fe48d475ea] AMQP server on 10.222.0.73:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 16 09:55:48.209741 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-5ae21ae0-ae38-4aa1-978f-385cf64651b0 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "POST /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.772873 Sep 16 09:55:48.210603 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 359/714] 10.222.0.73 () {60 vars in 1323 bytes} [Fri Sep 16 09:55:47 2022] POST /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a/os-volume_attachments => generated 194 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 09:55:48.928385 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO oslo.messaging._drivers.impl_rabbit [None req-0b8e9cdf-f942-443d-947c-92a6a746f66a tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] [32a00f80-291a-45d9-9520-43fe48d475ea] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 37074. Sep 16 09:55:48.932197 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-0b8e9cdf-f942-443d-947c-92a6a746f66a tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.735173 Sep 16 09:55:48.932856 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 356/715] 10.222.0.73 () {60 vars in 1147 bytes} [Fri Sep 16 09:55:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 09:55:48.945077 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-81edfd0d-f240-42a9-927e-17cfc2cd276f tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:48.946044 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-81edfd0d-f240-42a9-927e-17cfc2cd276f tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] [instance: 8d0bc242-3744-4992-b1e3-819d84c53e50] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:49.000741 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-81edfd0d-f240-42a9-927e-17cfc2cd276f tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1142f8595de54bfc8f28a5152eaa00d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d2a4f111114064aa5a477177e6d1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:49.007870 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-81edfd0d-f240-42a9-927e-17cfc2cd276f tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] 10.222.0.73 "GET /compute/v2.1/servers/8d0bc242-3744-4992-b1e3-819d84c53e50" status: 200 len: 1217 microversion: 2.1 time: 0.067477 Sep 16 09:55:49.008436 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 360/716] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:48 2022] GET /compute/v2.1/servers/8d0bc242-3744-4992-b1e3-819d84c53e50 => generated 1217 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:55:50.030996 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-557910ba-c6fa-43db-aba4-d6749785197d tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:50.031611 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-557910ba-c6fa-43db-aba4-d6749785197d tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] [instance: 8d0bc242-3744-4992-b1e3-819d84c53e50] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:50.039064 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-557910ba-c6fa-43db-aba4-d6749785197d tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:50.039553 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-557910ba-c6fa-43db-aba4-d6749785197d tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:50.040018 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-557910ba-c6fa-43db-aba4-d6749785197d tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:50.040716 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-557910ba-c6fa-43db-aba4-d6749785197d tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:50.041180 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-557910ba-c6fa-43db-aba4-d6749785197d tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:50.041630 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-557910ba-c6fa-43db-aba4-d6749785197d tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:50.102870 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-557910ba-c6fa-43db-aba4-d6749785197d tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1142f8595de54bfc8f28a5152eaa00d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d2a4f111114064aa5a477177e6d1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:50.111379 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-557910ba-c6fa-43db-aba4-d6749785197d tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] 10.222.0.73 "GET /compute/v2.1/servers/8d0bc242-3744-4992-b1e3-819d84c53e50" status: 200 len: 1221 microversion: 2.1 time: 0.084836 Sep 16 09:55:50.111939 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 357/717] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:50 2022] GET /compute/v2.1/servers/8d0bc242-3744-4992-b1e3-819d84c53e50 => generated 1221 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:55:51.134678 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-846389f1-c071-4878-a774-1ad214805bc2 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:51.135905 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-846389f1-c071-4878-a774-1ad214805bc2 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] [instance: 8d0bc242-3744-4992-b1e3-819d84c53e50] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:51.145181 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-846389f1-c071-4878-a774-1ad214805bc2 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:51.145952 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-846389f1-c071-4878-a774-1ad214805bc2 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:51.146502 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-846389f1-c071-4878-a774-1ad214805bc2 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:51.147219 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-846389f1-c071-4878-a774-1ad214805bc2 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:51.147689 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-846389f1-c071-4878-a774-1ad214805bc2 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:51.148125 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-846389f1-c071-4878-a774-1ad214805bc2 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:51.213913 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-846389f1-c071-4878-a774-1ad214805bc2 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1142f8595de54bfc8f28a5152eaa00d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d2a4f111114064aa5a477177e6d1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:51.221985 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-846389f1-c071-4878-a774-1ad214805bc2 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] 10.222.0.73 "GET /compute/v2.1/servers/8d0bc242-3744-4992-b1e3-819d84c53e50" status: 200 len: 1277 microversion: 2.1 time: 0.091262 Sep 16 09:55:51.222487 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 361/718] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:51 2022] GET /compute/v2.1/servers/8d0bc242-3744-4992-b1e3-819d84c53e50 => generated 1277 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:55:52.244221 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-73adc3cf-ad26-4258-8ee1-517981ae0789 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:52.245131 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-73adc3cf-ad26-4258-8ee1-517981ae0789 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] [instance: 8d0bc242-3744-4992-b1e3-819d84c53e50] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:52.251681 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-73adc3cf-ad26-4258-8ee1-517981ae0789 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:52.252175 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-73adc3cf-ad26-4258-8ee1-517981ae0789 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:52.252614 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-73adc3cf-ad26-4258-8ee1-517981ae0789 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:52.253311 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-73adc3cf-ad26-4258-8ee1-517981ae0789 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:52.253797 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-73adc3cf-ad26-4258-8ee1-517981ae0789 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:52.254228 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-73adc3cf-ad26-4258-8ee1-517981ae0789 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:52.462082 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-73adc3cf-ad26-4258-8ee1-517981ae0789 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1142f8595de54bfc8f28a5152eaa00d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d2a4f111114064aa5a477177e6d1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:52.475103 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-73adc3cf-ad26-4258-8ee1-517981ae0789 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] 10.222.0.73 "GET /compute/v2.1/servers/8d0bc242-3744-4992-b1e3-819d84c53e50" status: 200 len: 1317 microversion: 2.1 time: 0.234634 Sep 16 09:55:52.491090 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 358/719] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:52 2022] GET /compute/v2.1/servers/8d0bc242-3744-4992-b1e3-819d84c53e50 => generated 1317 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:55:53.044864 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [req-8aab3102-3db4-43e1-b0a8-1abf6aa208a3 req-aa45665e-c9f5-44f7-9cc7-ee7ea3af6a8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d0bc242-3744-4992-b1e3-819d84c53e50", "tag": "fe584d9e-61d6-4f6d-bd29-09afbf94e2fe"}]} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:55:53.055345 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-8aab3102-3db4-43e1-b0a8-1abf6aa208a3 req-aa45665e-c9f5-44f7-9cc7-ee7ea3af6a8f service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:53.055830 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-8aab3102-3db4-43e1-b0a8-1abf6aa208a3 req-aa45665e-c9f5-44f7-9cc7-ee7ea3af6a8f service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:53.056264 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-8aab3102-3db4-43e1-b0a8-1abf6aa208a3 req-aa45665e-c9f5-44f7-9cc7-ee7ea3af6a8f service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:53.067689 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.compute.server_external_events [req-8aab3102-3db4-43e1-b0a8-1abf6aa208a3 req-aa45665e-c9f5-44f7-9cc7-ee7ea3af6a8f service nova] Creating event network-changed:fe584d9e-61d6-4f6d-bd29-09afbf94e2fe for instance 8d0bc242-3744-4992-b1e3-819d84c53e50 on hv-cinder-79053 Sep 16 09:55:53.072457 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [req-8aab3102-3db4-43e1-b0a8-1abf6aa208a3 req-aa45665e-c9f5-44f7-9cc7-ee7ea3af6a8f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031348 Sep 16 09:55:53.074136 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 362/720] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:55:53.523183 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-6096bbeb-af89-4ad4-b059-97a914bd9cb6 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:53.523183 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-6096bbeb-af89-4ad4-b059-97a914bd9cb6 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] [instance: 8d0bc242-3744-4992-b1e3-819d84c53e50] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:53.523183 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6096bbeb-af89-4ad4-b059-97a914bd9cb6 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:53.523183 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6096bbeb-af89-4ad4-b059-97a914bd9cb6 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:53.524057 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6096bbeb-af89-4ad4-b059-97a914bd9cb6 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:53.524057 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6096bbeb-af89-4ad4-b059-97a914bd9cb6 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:53.524057 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6096bbeb-af89-4ad4-b059-97a914bd9cb6 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:53.524057 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6096bbeb-af89-4ad4-b059-97a914bd9cb6 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:53.705951 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-6096bbeb-af89-4ad4-b059-97a914bd9cb6 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1142f8595de54bfc8f28a5152eaa00d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d2a4f111114064aa5a477177e6d1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:53.713648 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-6096bbeb-af89-4ad4-b059-97a914bd9cb6 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] 10.222.0.73 "GET /compute/v2.1/servers/8d0bc242-3744-4992-b1e3-819d84c53e50" status: 200 len: 1317 microversion: 2.1 time: 0.218612 Sep 16 09:55:53.714221 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 359/721] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:53 2022] GET /compute/v2.1/servers/8d0bc242-3744-4992-b1e3-819d84c53e50 => generated 1317 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:55:54.737515 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-5a58c0a1-2085-4eff-8e76-dae4a4c24c2c tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:54.738157 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-5a58c0a1-2085-4eff-8e76-dae4a4c24c2c tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] [instance: 8d0bc242-3744-4992-b1e3-819d84c53e50] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:54.744376 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5a58c0a1-2085-4eff-8e76-dae4a4c24c2c tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:54.744861 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5a58c0a1-2085-4eff-8e76-dae4a4c24c2c tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:54.745292 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5a58c0a1-2085-4eff-8e76-dae4a4c24c2c tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:54.746113 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5a58c0a1-2085-4eff-8e76-dae4a4c24c2c tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:54.746564 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5a58c0a1-2085-4eff-8e76-dae4a4c24c2c tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:54.746986 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5a58c0a1-2085-4eff-8e76-dae4a4c24c2c tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:54.876347 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-5a58c0a1-2085-4eff-8e76-dae4a4c24c2c tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1142f8595de54bfc8f28a5152eaa00d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d2a4f111114064aa5a477177e6d1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:54.884835 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-5a58c0a1-2085-4eff-8e76-dae4a4c24c2c tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] 10.222.0.73 "GET /compute/v2.1/servers/8d0bc242-3744-4992-b1e3-819d84c53e50" status: 200 len: 1317 microversion: 2.1 time: 0.152138 Sep 16 09:55:54.888480 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 363/722] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:54 2022] GET /compute/v2.1/servers/8d0bc242-3744-4992-b1e3-819d84c53e50 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:55:55.059144 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-c570e29e-3144-4a83-bbbb-1ba5e57f275c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:55.059652 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-c570e29e-3144-4a83-bbbb-1ba5e57f275c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:55.066644 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c570e29e-3144-4a83-bbbb-1ba5e57f275c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:55.067125 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c570e29e-3144-4a83-bbbb-1ba5e57f275c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:55.067562 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c570e29e-3144-4a83-bbbb-1ba5e57f275c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:55.068242 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c570e29e-3144-4a83-bbbb-1ba5e57f275c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:55.068696 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c570e29e-3144-4a83-bbbb-1ba5e57f275c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:55.069115 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c570e29e-3144-4a83-bbbb-1ba5e57f275c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:55.086920 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:55:55.152767 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.objects.instance [None req-c570e29e-3144-4a83-bbbb-1ba5e57f275c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lazy-loading 'services' on Instance uuid bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa {{(pid=127670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 09:55:55.398546 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-c570e29e-3144-4a83-bbbb-1ba5e57f275c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "DELETE /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa/os-volume_attachments/7ac2bcb1-a7b1-4e12-9c85-de588838b70e" status: 202 len: 0 microversion: 2.1 time: 0.343107 Sep 16 09:55:55.399159 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 360/723] 10.222.0.73 () {58 vars in 1416 bytes} [Fri Sep 16 09:55:55 2022] DELETE /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa/os-volume_attachments/7ac2bcb1-a7b1-4e12-9c85-de588838b70e => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 09:55:55.407562 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-065fa756-38f0-4d18-9b88-08160866214c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:55.409986 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-065fa756-38f0-4d18-9b88-08160866214c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:55.416047 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-065fa756-38f0-4d18-9b88-08160866214c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:55.419233 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-065fa756-38f0-4d18-9b88-08160866214c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:55.419233 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-065fa756-38f0-4d18-9b88-08160866214c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:55.419233 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-065fa756-38f0-4d18-9b88-08160866214c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:55.419233 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-065fa756-38f0-4d18-9b88-08160866214c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:55.419593 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-065fa756-38f0-4d18-9b88-08160866214c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:55.448718 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-065fa756-38f0-4d18-9b88-08160866214c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044981 Sep 16 09:55:55.449682 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 364/724] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Sep 16 09:55:55 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:55:55.833652 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-0e967666-e473-40c3-b7ec-354d5309a71e tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d7017f7-c1b2-4632-a142-bfb53466b5d0"}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:55:55.836110 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-0e967666-e473-40c3-b7ec-354d5309a71e tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: db7a1d44-25f8-48e4-a8b6-f6ea14a508cb] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:55.842262 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0e967666-e473-40c3-b7ec-354d5309a71e tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:55.842744 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0e967666-e473-40c3-b7ec-354d5309a71e tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:55.843194 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0e967666-e473-40c3-b7ec-354d5309a71e tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:55.843854 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0e967666-e473-40c3-b7ec-354d5309a71e tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:55.844304 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0e967666-e473-40c3-b7ec-354d5309a71e tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:55.844726 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0e967666-e473-40c3-b7ec-354d5309a71e tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:55.908954 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-5e407d22-bf38-4826-a477-3617f5012e38 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:55.909748 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-5e407d22-bf38-4826-a477-3617f5012e38 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] [instance: 8d0bc242-3744-4992-b1e3-819d84c53e50] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:55.912260 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_api:SELECT=72 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:55:55.917054 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5e407d22-bf38-4826-a477-3617f5012e38 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:55.917554 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5e407d22-bf38-4826-a477-3617f5012e38 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:55.918225 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5e407d22-bf38-4826-a477-3617f5012e38 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:55.918929 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5e407d22-bf38-4826-a477-3617f5012e38 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:55.919408 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5e407d22-bf38-4826-a477-3617f5012e38 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:55.919832 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5e407d22-bf38-4826-a477-3617f5012e38 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:55.926293 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.wsgi [None req-0e967666-e473-40c3-b7ec-354d5309a71e tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] HTTP exception thrown: Invalid volume: volume 3d7017f7-c1b2-4632-a142-bfb53466b5d0 is already attached to instances: db7a1d44-25f8-48e4-a8b6-f6ea14a508cb Sep 16 09:55:55.928019 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-0e967666-e473-40c3-b7ec-354d5309a71e tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Request method failure captured: Sep 16 09:55:55.928019 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: request: POST /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb/os-volume_attachments HTTP/1.1 Sep 16 09:55:55.928019 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept: application/json Sep 16 09:55:55.928019 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Sep 16 09:55:55.928019 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Connection: close Sep 16 09:55:55.928019 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Length: 74 Sep 16 09:55:55.928019 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Type: application/json Sep 16 09:55:55.928019 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Host: 10.222.0.73 Sep 16 09:55:55.928019 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Sep 16 09:55:55.928019 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Sep 16 09:55:55.928019 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjJEbyIogtO-fgeLO9uv3_XXDwxtVD1eIMLN7x0Q3ZD4pj8hYAM6nbLEwKtYbBaube26iELy7B5lx0xTiRTzRgXZs50v25I7qfb15XuH_i9MG8_BlVJAG6OZoKZu6GI9c8evKltkWyTv3vVrhFavNaXN0ju9i-ZnFY6eOsWcD7CFugHvs Sep 16 09:55:55.928019 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Sep 16 09:55:55.928019 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Sep 16 09:55:55.928019 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Sep 16 09:55:55.928019 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Sep 16 09:55:55.928019 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Sep 16 09:55:55.928019 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Sep 16 09:55:55.928019 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Id: 75007587f92646f686881c2e1bfb7b2d Sep 16 09:55:55.928019 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-AttachVolumeNegativeTest-1478592665 Sep 16 09:55:55.928019 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Role: reader,member Sep 16 09:55:55.928019 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Roles: reader,member Sep 16 09:55:55.929718 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/75007587f92646f686881c2e1bfb7b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_75007587f92646f686881c2e1bfb7b2d", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/75007587f92646f686881c2e1bfb7b2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/75007587f92646f686881c2e1bfb7b2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 09:55:55.929718 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-AttachVolumeNegativeTest-1478592665 Sep 16 09:55:55.929718 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Id: 75007587f92646f686881c2e1bfb7b2d Sep 16 09:55:55.929718 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1478592665 Sep 16 09:55:55.929718 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User: tempest-AttachVolumeNegativeTest-1478592665-project Sep 16 09:55:55.929718 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Sep 16 09:55:55.929718 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Sep 16 09:55:55.929718 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Id: 7dca5726e89343828e25def6e6c274bb Sep 16 09:55:55.929718 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-AttachVolumeNegativeTest-1478592665-project Sep 16 09:55:55.929718 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Sep 16 09:55:55.929718 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: {"volumeAttachment": {"volumeId": "3d7017f7-c1b2-4632-a142-bfb53466b5d0"}} Sep 16 09:55:55.929718 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: method: > Sep 16 09:55:55.932458 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: exception: Invalid volume: volume 3d7017f7-c1b2-4632-a142-bfb53466b5d0 is already attached to instances: db7a1d44-25f8-48e4-a8b6-f6ea14a508cb Sep 16 09:55:55.932458 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: action_args: {'server_id': 'db7a1d44-25f8-48e4-a8b6-f6ea14a508cb', 'body': {'volumeAttachment': {'volumeId': '3d7017f7-c1b2-4632-a142-bfb53466b5d0'}}} Sep 16 09:55:55.932458 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 09:55:55.932458 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:55:55.932458 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 16 09:55:55.932458 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 16 09:55:55.932458 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 16 09:55:55.932458 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 16 09:55:55.932458 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 16 09:55:55.932458 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 16 09:55:55.932458 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 16 09:55:55.932458 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 16 09:55:55.932458 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 16 09:55:55.932458 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 16 09:55:55.932458 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3d7017f7-c1b2-4632-a142-bfb53466b5d0 is already attached to instances: db7a1d44-25f8-48e4-a8b6-f6ea14a508cb Sep 16 09:55:55.932458 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:55:55.932458 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:55:55.932458 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:55:55.932458 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:55:55.934036 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:55:55.934036 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:55:55.934036 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 09:55:55.934036 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 09:55:55.934036 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 09:55:55.934036 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:55:55.934036 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 09:55:55.934036 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 09:55:55.934036 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 09:55:55.934036 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 09:55:55.934036 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 09:55:55.934036 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 09:55:55.934036 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 16 09:55:55.934036 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 16 09:55:55.934036 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3d7017f7-c1b2-4632-a142-bfb53466b5d0 is already attached to instances: db7a1d44-25f8-48e4-a8b6-f6ea14a508cb Sep 16 09:55:55.934036 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:55:55.934036 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:55:55.934036 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:55:55.934036 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:55:55.934036 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:55:55.935525 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:55:55.935525 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 09:55:55.935525 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 09:55:55.935525 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3d7017f7-c1b2-4632-a142-bfb53466b5d0 is already attached to instances: db7a1d44-25f8-48e4-a8b6-f6ea14a508cb Sep 16 09:55:55.935525 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:55:55.935525 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-0e967666-e473-40c3-b7ec-354d5309a71e tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Returning 400 to user: Invalid volume: volume 3d7017f7-c1b2-4632-a142-bfb53466b5d0 is already attached to instances: db7a1d44-25f8-48e4-a8b6-f6ea14a508cb {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 09:55:55.935525 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-0e967666-e473-40c3-b7ec-354d5309a71e tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "POST /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100209 Sep 16 09:55:55.935525 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 361/725] 10.222.0.73 () {60 vars in 1323 bytes} [Fri Sep 16 09:55:55 2022] POST /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 09:55:55.998630 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-eecc0cc0-7d71-41cd-a9c7-9e331f4f306b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:56.000530 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-eecc0cc0-7d71-41cd-a9c7-9e331f4f306b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: db7a1d44-25f8-48e4-a8b6-f6ea14a508cb] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:56.006727 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-eecc0cc0-7d71-41cd-a9c7-9e331f4f306b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:56.007325 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-eecc0cc0-7d71-41cd-a9c7-9e331f4f306b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:56.007870 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-eecc0cc0-7d71-41cd-a9c7-9e331f4f306b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:56.008667 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-eecc0cc0-7d71-41cd-a9c7-9e331f4f306b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:56.009224 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-eecc0cc0-7d71-41cd-a9c7-9e331f4f306b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:56.009695 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-eecc0cc0-7d71-41cd-a9c7-9e331f4f306b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:56.059556 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-5e407d22-bf38-4826-a477-3617f5012e38 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1142f8595de54bfc8f28a5152eaa00d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d2a4f111114064aa5a477177e6d1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:56.067280 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-5e407d22-bf38-4826-a477-3617f5012e38 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] 10.222.0.73 "GET /compute/v2.1/servers/8d0bc242-3744-4992-b1e3-819d84c53e50" status: 200 len: 1317 microversion: 2.1 time: 0.162877 Sep 16 09:55:56.067847 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 365/726] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:55 2022] GET /compute/v2.1/servers/8d0bc242-3744-4992-b1e3-819d84c53e50 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:55:56.093069 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.objects.instance [None req-eecc0cc0-7d71-41cd-a9c7-9e331f4f306b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lazy-loading 'services' on Instance uuid db7a1d44-25f8-48e4-a8b6-f6ea14a508cb {{(pid=127670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 09:55:56.306908 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-eecc0cc0-7d71-41cd-a9c7-9e331f4f306b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "DELETE /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb/os-volume_attachments/3d7017f7-c1b2-4632-a142-bfb53466b5d0" status: 202 len: 0 microversion: 2.1 time: 0.311959 Sep 16 09:55:56.307573 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 362/727] 10.222.0.73 () {58 vars in 1416 bytes} [Fri Sep 16 09:55:55 2022] DELETE /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb/os-volume_attachments/3d7017f7-c1b2-4632-a142-bfb53466b5d0 => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 09:55:56.316459 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-e39d4240-9e8a-49c9-a14c-a4fa676ef7c3 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:56.323354 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-e39d4240-9e8a-49c9-a14c-a4fa676ef7c3 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: db7a1d44-25f8-48e4-a8b6-f6ea14a508cb] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:56.324834 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e39d4240-9e8a-49c9-a14c-a4fa676ef7c3 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:56.325332 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e39d4240-9e8a-49c9-a14c-a4fa676ef7c3 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:56.325805 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e39d4240-9e8a-49c9-a14c-a4fa676ef7c3 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:56.326507 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e39d4240-9e8a-49c9-a14c-a4fa676ef7c3 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:56.326970 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e39d4240-9e8a-49c9-a14c-a4fa676ef7c3 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:56.327398 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e39d4240-9e8a-49c9-a14c-a4fa676ef7c3 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:56.358361 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-e39d4240-9e8a-49c9-a14c-a4fa676ef7c3 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046096 Sep 16 09:55:56.358854 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 366/728] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Sep 16 09:55:56 2022] GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:55:56.463568 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-1fae7ce0-b15b-4ce6-ae3c-97eb6df80258 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:56.465948 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-1fae7ce0-b15b-4ce6-ae3c-97eb6df80258 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:56.472444 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1fae7ce0-b15b-4ce6-ae3c-97eb6df80258 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:56.472795 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1fae7ce0-b15b-4ce6-ae3c-97eb6df80258 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:56.473231 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1fae7ce0-b15b-4ce6-ae3c-97eb6df80258 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:56.473982 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1fae7ce0-b15b-4ce6-ae3c-97eb6df80258 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:56.474549 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1fae7ce0-b15b-4ce6-ae3c-97eb6df80258 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:56.474885 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1fae7ce0-b15b-4ce6-ae3c-97eb6df80258 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:56.503961 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-1fae7ce0-b15b-4ce6-ae3c-97eb6df80258 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045861 Sep 16 09:55:56.504499 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 363/729] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Sep 16 09:55:56 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:55:57.091286 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-dce6586d-4d8b-47e6-906e-774e857cfda8 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:57.091897 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-dce6586d-4d8b-47e6-906e-774e857cfda8 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] [instance: 8d0bc242-3744-4992-b1e3-819d84c53e50] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:57.098873 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-dce6586d-4d8b-47e6-906e-774e857cfda8 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:57.099358 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-dce6586d-4d8b-47e6-906e-774e857cfda8 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:57.099800 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-dce6586d-4d8b-47e6-906e-774e857cfda8 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:57.100493 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-dce6586d-4d8b-47e6-906e-774e857cfda8 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:57.100950 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-dce6586d-4d8b-47e6-906e-774e857cfda8 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:57.101378 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-dce6586d-4d8b-47e6-906e-774e857cfda8 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:57.235286 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-dce6586d-4d8b-47e6-906e-774e857cfda8 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1142f8595de54bfc8f28a5152eaa00d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d2a4f111114064aa5a477177e6d1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:57.243494 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-dce6586d-4d8b-47e6-906e-774e857cfda8 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] 10.222.0.73 "GET /compute/v2.1/servers/8d0bc242-3744-4992-b1e3-819d84c53e50" status: 200 len: 1317 microversion: 2.1 time: 0.156127 Sep 16 09:55:57.244058 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 367/730] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:57 2022] GET /compute/v2.1/servers/8d0bc242-3744-4992-b1e3-819d84c53e50 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:55:57.371085 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-78bc12e1-d7bd-4ed7-97ba-6772578d5566 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:57.373174 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-78bc12e1-d7bd-4ed7-97ba-6772578d5566 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: db7a1d44-25f8-48e4-a8b6-f6ea14a508cb] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:57.380076 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-78bc12e1-d7bd-4ed7-97ba-6772578d5566 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:57.380555 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-78bc12e1-d7bd-4ed7-97ba-6772578d5566 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:57.380993 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-78bc12e1-d7bd-4ed7-97ba-6772578d5566 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:57.381726 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-78bc12e1-d7bd-4ed7-97ba-6772578d5566 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:57.382183 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-78bc12e1-d7bd-4ed7-97ba-6772578d5566 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:57.382614 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-78bc12e1-d7bd-4ed7-97ba-6772578d5566 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:57.411833 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-78bc12e1-d7bd-4ed7-97ba-6772578d5566 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044798 Sep 16 09:55:57.412385 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 364/731] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Sep 16 09:55:57 2022] GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:55:57.515874 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-cef0de33-748a-4949-8c4d-73d03108dc3c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:57.518429 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-cef0de33-748a-4949-8c4d-73d03108dc3c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:57.524343 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-cef0de33-748a-4949-8c4d-73d03108dc3c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:57.524860 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-cef0de33-748a-4949-8c4d-73d03108dc3c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:57.525301 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-cef0de33-748a-4949-8c4d-73d03108dc3c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:57.526018 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-cef0de33-748a-4949-8c4d-73d03108dc3c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:57.526476 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-cef0de33-748a-4949-8c4d-73d03108dc3c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:57.526911 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-cef0de33-748a-4949-8c4d-73d03108dc3c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:57.556408 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-cef0de33-748a-4949-8c4d-73d03108dc3c tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044537 Sep 16 09:55:57.556946 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 368/732] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Sep 16 09:55:57 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:55:58.265664 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-c59d7d1f-960e-4842-8fba-f0d54df02764 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:58.266282 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-c59d7d1f-960e-4842-8fba-f0d54df02764 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] [instance: 8d0bc242-3744-4992-b1e3-819d84c53e50] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:58.269161 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell0:SELECT=4 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:55:58.269581 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell0:SELECT=6 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:55:58.274581 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c59d7d1f-960e-4842-8fba-f0d54df02764 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:58.275092 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c59d7d1f-960e-4842-8fba-f0d54df02764 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:58.275562 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c59d7d1f-960e-4842-8fba-f0d54df02764 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:58.276272 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c59d7d1f-960e-4842-8fba-f0d54df02764 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:58.276738 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c59d7d1f-960e-4842-8fba-f0d54df02764 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:58.277289 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c59d7d1f-960e-4842-8fba-f0d54df02764 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:58.408830 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c59d7d1f-960e-4842-8fba-f0d54df02764 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1142f8595de54bfc8f28a5152eaa00d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d2a4f111114064aa5a477177e6d1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:58.416496 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-c59d7d1f-960e-4842-8fba-f0d54df02764 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] 10.222.0.73 "GET /compute/v2.1/servers/8d0bc242-3744-4992-b1e3-819d84c53e50" status: 200 len: 1317 microversion: 2.1 time: 0.154715 Sep 16 09:55:58.417061 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 365/733] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:58 2022] GET /compute/v2.1/servers/8d0bc242-3744-4992-b1e3-819d84c53e50 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:55:58.424634 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-386e617a-5d60-4502-98c9-8f707b3cdb5b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:58.433501 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-386e617a-5d60-4502-98c9-8f707b3cdb5b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: db7a1d44-25f8-48e4-a8b6-f6ea14a508cb] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:58.433755 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-386e617a-5d60-4502-98c9-8f707b3cdb5b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:58.434240 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-386e617a-5d60-4502-98c9-8f707b3cdb5b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:58.434675 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-386e617a-5d60-4502-98c9-8f707b3cdb5b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:58.435361 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-386e617a-5d60-4502-98c9-8f707b3cdb5b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:58.435841 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-386e617a-5d60-4502-98c9-8f707b3cdb5b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:58.436290 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-386e617a-5d60-4502-98c9-8f707b3cdb5b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:58.467168 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-386e617a-5d60-4502-98c9-8f707b3cdb5b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046724 Sep 16 09:55:58.467724 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 369/734] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Sep 16 09:55:58 2022] GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:55:58.568658 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-e4df8726-47b9-4e01-be21-8e9287f5b7d6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:58.570921 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-e4df8726-47b9-4e01-be21-8e9287f5b7d6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:58.576719 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e4df8726-47b9-4e01-be21-8e9287f5b7d6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:58.577206 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e4df8726-47b9-4e01-be21-8e9287f5b7d6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:58.577675 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e4df8726-47b9-4e01-be21-8e9287f5b7d6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:58.578380 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e4df8726-47b9-4e01-be21-8e9287f5b7d6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:58.578838 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e4df8726-47b9-4e01-be21-8e9287f5b7d6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:58.579269 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e4df8726-47b9-4e01-be21-8e9287f5b7d6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:58.610052 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-e4df8726-47b9-4e01-be21-8e9287f5b7d6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045322 Sep 16 09:55:58.614533 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 366/735] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Sep 16 09:55:58 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:55:59.439382 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-b66df8d6-84a4-489a-8746-2c13173c1ecd tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:59.439990 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-b66df8d6-84a4-489a-8746-2c13173c1ecd tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] [instance: 8d0bc242-3744-4992-b1e3-819d84c53e50] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:59.441890 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell0:SELECT=2 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:55:59.447229 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b66df8d6-84a4-489a-8746-2c13173c1ecd tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:59.451075 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b66df8d6-84a4-489a-8746-2c13173c1ecd tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:59.451075 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b66df8d6-84a4-489a-8746-2c13173c1ecd tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:59.451075 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b66df8d6-84a4-489a-8746-2c13173c1ecd tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:59.451075 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b66df8d6-84a4-489a-8746-2c13173c1ecd tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:59.451449 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b66df8d6-84a4-489a-8746-2c13173c1ecd tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:59.480504 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-906b119b-2127-4b07-b74a-b640fe7c5178 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:59.482766 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-906b119b-2127-4b07-b74a-b640fe7c5178 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: db7a1d44-25f8-48e4-a8b6-f6ea14a508cb] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:59.490370 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-906b119b-2127-4b07-b74a-b640fe7c5178 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:59.490944 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-906b119b-2127-4b07-b74a-b640fe7c5178 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:59.491462 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-906b119b-2127-4b07-b74a-b640fe7c5178 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:59.492237 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-906b119b-2127-4b07-b74a-b640fe7c5178 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:59.492795 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-906b119b-2127-4b07-b74a-b640fe7c5178 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:59.493295 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-906b119b-2127-4b07-b74a-b640fe7c5178 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:59.523267 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-906b119b-2127-4b07-b74a-b640fe7c5178 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046912 Sep 16 09:55:59.523839 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 367/736] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Sep 16 09:55:59 2022] GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 09:55:59.579299 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-b66df8d6-84a4-489a-8746-2c13173c1ecd tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1142f8595de54bfc8f28a5152eaa00d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d2a4f111114064aa5a477177e6d1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:55:59.586975 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-b66df8d6-84a4-489a-8746-2c13173c1ecd tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] 10.222.0.73 "GET /compute/v2.1/servers/8d0bc242-3744-4992-b1e3-819d84c53e50" status: 200 len: 1317 microversion: 2.1 time: 0.151979 Sep 16 09:55:59.587543 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 370/737] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:55:59 2022] GET /compute/v2.1/servers/8d0bc242-3744-4992-b1e3-819d84c53e50 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:55:59.622178 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-2199ccfe-c66a-4c58-a94b-56c3d1a99356 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:55:59.624279 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-2199ccfe-c66a-4c58-a94b-56c3d1a99356 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:55:59.630109 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2199ccfe-c66a-4c58-a94b-56c3d1a99356 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:59.630589 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2199ccfe-c66a-4c58-a94b-56c3d1a99356 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:59.631023 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2199ccfe-c66a-4c58-a94b-56c3d1a99356 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:59.631703 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2199ccfe-c66a-4c58-a94b-56c3d1a99356 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:55:59.632156 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2199ccfe-c66a-4c58-a94b-56c3d1a99356 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:55:59.632570 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2199ccfe-c66a-4c58-a94b-56c3d1a99356 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:55:59.662424 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-2199ccfe-c66a-4c58-a94b-56c3d1a99356 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044132 Sep 16 09:55:59.662981 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 368/738] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Sep 16 09:55:59 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:56:00.171809 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [req-ee758fd1-5ea3-42a1-8b45-80da622fffc3 req-515adc1d-3c54-4909-9f21-965fb6ffc51b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d0bc242-3744-4992-b1e3-819d84c53e50", "name": "network-vif-plugged", "status": "completed", "tag": "fe584d9e-61d6-4f6d-bd29-09afbf94e2fe"}]} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:56:00.181522 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-ee758fd1-5ea3-42a1-8b45-80da622fffc3 req-515adc1d-3c54-4909-9f21-965fb6ffc51b service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:00.182079 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-ee758fd1-5ea3-42a1-8b45-80da622fffc3 req-515adc1d-3c54-4909-9f21-965fb6ffc51b service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:00.182502 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-ee758fd1-5ea3-42a1-8b45-80da622fffc3 req-515adc1d-3c54-4909-9f21-965fb6ffc51b service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:00.194131 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.compute.server_external_events [req-ee758fd1-5ea3-42a1-8b45-80da622fffc3 req-515adc1d-3c54-4909-9f21-965fb6ffc51b service nova] Creating event network-vif-plugged:fe584d9e-61d6-4f6d-bd29-09afbf94e2fe for instance 8d0bc242-3744-4992-b1e3-819d84c53e50 on hv-cinder-79053 Sep 16 09:56:00.199086 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [req-ee758fd1-5ea3-42a1-8b45-80da622fffc3 req-515adc1d-3c54-4909-9f21-965fb6ffc51b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031197 Sep 16 09:56:00.199660 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 371/739] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:56:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:56:00.535338 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-43d60cc3-33ad-4759-a418-a953a4c3190a tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:00.537457 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-43d60cc3-33ad-4759-a418-a953a4c3190a tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: db7a1d44-25f8-48e4-a8b6-f6ea14a508cb] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:00.543941 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-43d60cc3-33ad-4759-a418-a953a4c3190a tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:00.544436 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-43d60cc3-33ad-4759-a418-a953a4c3190a tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:00.544879 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-43d60cc3-33ad-4759-a418-a953a4c3190a tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:00.545772 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-43d60cc3-33ad-4759-a418-a953a4c3190a tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:00.546240 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-43d60cc3-33ad-4759-a418-a953a4c3190a tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:00.546673 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-43d60cc3-33ad-4759-a418-a953a4c3190a tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:00.578657 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-43d60cc3-33ad-4759-a418-a953a4c3190a tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047847 Sep 16 09:56:00.579901 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 369/740] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Sep 16 09:56:00 2022] GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:56:00.612637 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-ae6b147a-d447-4798-a144-bba4be80b853 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:00.614380 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-ae6b147a-d447-4798-a144-bba4be80b853 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] [instance: 8d0bc242-3744-4992-b1e3-819d84c53e50] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:00.620662 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ae6b147a-d447-4798-a144-bba4be80b853 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:00.621152 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ae6b147a-d447-4798-a144-bba4be80b853 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:00.621621 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ae6b147a-d447-4798-a144-bba4be80b853 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:00.622332 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ae6b147a-d447-4798-a144-bba4be80b853 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:00.622794 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ae6b147a-d447-4798-a144-bba4be80b853 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:00.623227 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ae6b147a-d447-4798-a144-bba4be80b853 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:00.675367 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-63ea4c80-a096-4994-b09c-eba39f7e189e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:00.677569 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-63ea4c80-a096-4994-b09c-eba39f7e189e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:00.683589 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-63ea4c80-a096-4994-b09c-eba39f7e189e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:00.684976 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-63ea4c80-a096-4994-b09c-eba39f7e189e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:00.685420 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-63ea4c80-a096-4994-b09c-eba39f7e189e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:00.686162 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-63ea4c80-a096-4994-b09c-eba39f7e189e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:00.690652 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-63ea4c80-a096-4994-b09c-eba39f7e189e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:00.690652 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-63ea4c80-a096-4994-b09c-eba39f7e189e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:00.718439 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-63ea4c80-a096-4994-b09c-eba39f7e189e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047584 Sep 16 09:56:00.719021 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 370/741] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Sep 16 09:56:00 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 09:56:00.760143 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-ae6b147a-d447-4798-a144-bba4be80b853 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1142f8595de54bfc8f28a5152eaa00d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d2a4f111114064aa5a477177e6d1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:00.768331 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-ae6b147a-d447-4798-a144-bba4be80b853 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] 10.222.0.73 "GET /compute/v2.1/servers/8d0bc242-3744-4992-b1e3-819d84c53e50" status: 200 len: 1317 microversion: 2.1 time: 0.161680 Sep 16 09:56:00.768896 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 372/742] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:00 2022] GET /compute/v2.1/servers/8d0bc242-3744-4992-b1e3-819d84c53e50 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:56:01.590478 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-39f4f831-cb07-4275-87d9-eddbceb34665 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:01.592628 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-39f4f831-cb07-4275-87d9-eddbceb34665 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: db7a1d44-25f8-48e4-a8b6-f6ea14a508cb] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:01.599685 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-39f4f831-cb07-4275-87d9-eddbceb34665 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:01.600166 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-39f4f831-cb07-4275-87d9-eddbceb34665 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:01.600601 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-39f4f831-cb07-4275-87d9-eddbceb34665 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:01.601279 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-39f4f831-cb07-4275-87d9-eddbceb34665 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:01.601773 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-39f4f831-cb07-4275-87d9-eddbceb34665 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:01.602193 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-39f4f831-cb07-4275-87d9-eddbceb34665 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:01.631541 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-39f4f831-cb07-4275-87d9-eddbceb34665 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044961 Sep 16 09:56:01.632078 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 371/743] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Sep 16 09:56:01 2022] GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:56:01.731359 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-54cc28fb-51d1-4a5c-aacd-9a9c7a28f1dc tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:01.733429 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-54cc28fb-51d1-4a5c-aacd-9a9c7a28f1dc tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:01.739952 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-54cc28fb-51d1-4a5c-aacd-9a9c7a28f1dc tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:01.740440 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-54cc28fb-51d1-4a5c-aacd-9a9c7a28f1dc tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:01.740883 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-54cc28fb-51d1-4a5c-aacd-9a9c7a28f1dc tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:01.741641 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-54cc28fb-51d1-4a5c-aacd-9a9c7a28f1dc tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:01.742103 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-54cc28fb-51d1-4a5c-aacd-9a9c7a28f1dc tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:01.742530 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-54cc28fb-51d1-4a5c-aacd-9a9c7a28f1dc tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:01.772807 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-54cc28fb-51d1-4a5c-aacd-9a9c7a28f1dc tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045918 Sep 16 09:56:01.773359 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 373/744] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Sep 16 09:56:01 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:56:01.791058 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-3ecd98ef-4cd3-477c-afb8-52d3b1c2a240 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:01.791682 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-3ecd98ef-4cd3-477c-afb8-52d3b1c2a240 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] [instance: 8d0bc242-3744-4992-b1e3-819d84c53e50] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:01.798423 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3ecd98ef-4cd3-477c-afb8-52d3b1c2a240 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:01.803396 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3ecd98ef-4cd3-477c-afb8-52d3b1c2a240 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:01.803396 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3ecd98ef-4cd3-477c-afb8-52d3b1c2a240 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:01.803396 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3ecd98ef-4cd3-477c-afb8-52d3b1c2a240 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:01.803396 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3ecd98ef-4cd3-477c-afb8-52d3b1c2a240 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:01.803792 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3ecd98ef-4cd3-477c-afb8-52d3b1c2a240 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:01.927307 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-3ecd98ef-4cd3-477c-afb8-52d3b1c2a240 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1142f8595de54bfc8f28a5152eaa00d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d2a4f111114064aa5a477177e6d1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:01.934989 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-3ecd98ef-4cd3-477c-afb8-52d3b1c2a240 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] 10.222.0.73 "GET /compute/v2.1/servers/8d0bc242-3744-4992-b1e3-819d84c53e50" status: 200 len: 1317 microversion: 2.1 time: 0.147900 Sep 16 09:56:01.935558 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 372/745] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:01 2022] GET /compute/v2.1/servers/8d0bc242-3744-4992-b1e3-819d84c53e50 => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:56:02.643641 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-b94fe0a6-9de6-4fef-9f39-0d49efef07f8 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:02.645830 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-b94fe0a6-9de6-4fef-9f39-0d49efef07f8 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: db7a1d44-25f8-48e4-a8b6-f6ea14a508cb] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:02.651989 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b94fe0a6-9de6-4fef-9f39-0d49efef07f8 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:02.652471 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b94fe0a6-9de6-4fef-9f39-0d49efef07f8 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:02.652905 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b94fe0a6-9de6-4fef-9f39-0d49efef07f8 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:02.653617 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b94fe0a6-9de6-4fef-9f39-0d49efef07f8 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:02.654074 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b94fe0a6-9de6-4fef-9f39-0d49efef07f8 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:02.654499 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b94fe0a6-9de6-4fef-9f39-0d49efef07f8 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:02.688724 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-b94fe0a6-9de6-4fef-9f39-0d49efef07f8 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049181 Sep 16 09:56:02.689362 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 374/746] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Sep 16 09:56:02 2022] GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:56:02.786322 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-1623b82c-5450-4f1a-b127-c2eb1174a0f8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:02.788423 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-1623b82c-5450-4f1a-b127-c2eb1174a0f8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:02.794951 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1623b82c-5450-4f1a-b127-c2eb1174a0f8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:02.795439 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1623b82c-5450-4f1a-b127-c2eb1174a0f8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:02.795880 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1623b82c-5450-4f1a-b127-c2eb1174a0f8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:02.796575 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1623b82c-5450-4f1a-b127-c2eb1174a0f8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:02.797040 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1623b82c-5450-4f1a-b127-c2eb1174a0f8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:02.797462 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1623b82c-5450-4f1a-b127-c2eb1174a0f8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:02.827449 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-1623b82c-5450-4f1a-b127-c2eb1174a0f8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046054 Sep 16 09:56:02.828017 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 373/747] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Sep 16 09:56:02 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:56:02.958527 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-918592a4-f0aa-47f7-b139-10597f9638fd tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:02.959145 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-918592a4-f0aa-47f7-b139-10597f9638fd tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] [instance: 8d0bc242-3744-4992-b1e3-819d84c53e50] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:02.965419 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-918592a4-f0aa-47f7-b139-10597f9638fd tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:02.965934 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-918592a4-f0aa-47f7-b139-10597f9638fd tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:02.966371 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-918592a4-f0aa-47f7-b139-10597f9638fd tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:02.967053 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-918592a4-f0aa-47f7-b139-10597f9638fd tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:02.967505 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-918592a4-f0aa-47f7-b139-10597f9638fd tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:02.967930 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-918592a4-f0aa-47f7-b139-10597f9638fd tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:03.097967 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-918592a4-f0aa-47f7-b139-10597f9638fd tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1142f8595de54bfc8f28a5152eaa00d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d2a4f111114064aa5a477177e6d1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:03.106215 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-918592a4-f0aa-47f7-b139-10597f9638fd tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] 10.222.0.73 "GET /compute/v2.1/servers/8d0bc242-3744-4992-b1e3-819d84c53e50" status: 200 len: 1505 microversion: 2.1 time: 0.152271 Sep 16 09:56:03.106783 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 375/748] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:02 2022] GET /compute/v2.1/servers/8d0bc242-3744-4992-b1e3-819d84c53e50 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:56:03.129256 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-0724df6b-4501-4a26-812c-75325233f7eb tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "00ae4bdd-6443-4836-ae4f-a5fb61672720", "device": "/dev/sdb"}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:56:03.132164 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-0724df6b-4501-4a26-812c-75325233f7eb tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] [instance: 8d0bc242-3744-4992-b1e3-819d84c53e50] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:03.138312 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0724df6b-4501-4a26-812c-75325233f7eb tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:03.138947 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0724df6b-4501-4a26-812c-75325233f7eb tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:03.139396 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0724df6b-4501-4a26-812c-75325233f7eb tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:03.140132 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0724df6b-4501-4a26-812c-75325233f7eb tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:03.140595 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0724df6b-4501-4a26-812c-75325233f7eb tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:03.141023 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0724df6b-4501-4a26-812c-75325233f7eb tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:03.679090 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:56:03.702588 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-fb709462-f7a8-439a-b562-16a0e5c00a15 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:03.704908 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-fb709462-f7a8-439a-b562-16a0e5c00a15 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: db7a1d44-25f8-48e4-a8b6-f6ea14a508cb] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:03.711013 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-fb709462-f7a8-439a-b562-16a0e5c00a15 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:03.711506 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-fb709462-f7a8-439a-b562-16a0e5c00a15 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:03.712073 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-fb709462-f7a8-439a-b562-16a0e5c00a15 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:03.712772 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-fb709462-f7a8-439a-b562-16a0e5c00a15 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:03.713259 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-fb709462-f7a8-439a-b562-16a0e5c00a15 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:03.713731 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-fb709462-f7a8-439a-b562-16a0e5c00a15 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:03.744032 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-fb709462-f7a8-439a-b562-16a0e5c00a15 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045447 Sep 16 09:56:03.744624 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 376/749] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Sep 16 09:56:03 2022] GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 09:56:03.820324 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-0724df6b-4501-4a26-812c-75325233f7eb tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] 10.222.0.73 "POST /compute/v2.1/servers/8d0bc242-3744-4992-b1e3-819d84c53e50/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.695504 Sep 16 09:56:03.820962 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 374/750] 10.222.0.73 () {60 vars in 1323 bytes} [Fri Sep 16 09:56:03 2022] POST /compute/v2.1/servers/8d0bc242-3744-4992-b1e3-819d84c53e50/os-volume_attachments => generated 194 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:56:03.844213 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-ff0317b9-dce5-42db-843c-09a865e4034d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:03.846468 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-ff0317b9-dce5-42db-843c-09a865e4034d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:03.852601 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ff0317b9-dce5-42db-843c-09a865e4034d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:03.853090 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ff0317b9-dce5-42db-843c-09a865e4034d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:03.853532 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ff0317b9-dce5-42db-843c-09a865e4034d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:03.854316 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ff0317b9-dce5-42db-843c-09a865e4034d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:03.854783 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ff0317b9-dce5-42db-843c-09a865e4034d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:03.855529 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ff0317b9-dce5-42db-843c-09a865e4034d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:03.881817 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:56:03.886619 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-ff0317b9-dce5-42db-843c-09a865e4034d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046400 Sep 16 09:56:03.889293 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 377/751] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Sep 16 09:56:03 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 09:56:04.371531 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-4b080924-0d6d-43ad-9017-5168005a9ba9 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:04.372244 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-4b080924-0d6d-43ad-9017-5168005a9ba9 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:04.379126 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4b080924-0d6d-43ad-9017-5168005a9ba9 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:04.379622 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4b080924-0d6d-43ad-9017-5168005a9ba9 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:04.380068 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4b080924-0d6d-43ad-9017-5168005a9ba9 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:04.380769 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4b080924-0d6d-43ad-9017-5168005a9ba9 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:04.381235 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4b080924-0d6d-43ad-9017-5168005a9ba9 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:04.381703 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4b080924-0d6d-43ad-9017-5168005a9ba9 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:04.521588 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-4b080924-0d6d-43ad-9017-5168005a9ba9 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b850cd7b216d4aab865886d20194f322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ebe25211ee4dcb887de8e0c9a03040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:04.529910 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-4b080924-0d6d-43ad-9017-5168005a9ba9 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a" status: 200 len: 1593 microversion: 2.1 time: 0.163074 Sep 16 09:56:04.530484 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 375/752] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:04 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a => generated 1593 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:56:04.757562 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-2b00d4cc-ceb9-40b9-94aa-9423d7d8a543 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:04.759745 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-2b00d4cc-ceb9-40b9-94aa-9423d7d8a543 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: db7a1d44-25f8-48e4-a8b6-f6ea14a508cb] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:04.766629 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2b00d4cc-ceb9-40b9-94aa-9423d7d8a543 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:04.769596 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2b00d4cc-ceb9-40b9-94aa-9423d7d8a543 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:04.769596 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2b00d4cc-ceb9-40b9-94aa-9423d7d8a543 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:04.769596 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2b00d4cc-ceb9-40b9-94aa-9423d7d8a543 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:04.769596 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2b00d4cc-ceb9-40b9-94aa-9423d7d8a543 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:04.770004 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2b00d4cc-ceb9-40b9-94aa-9423d7d8a543 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:04.802102 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-2b00d4cc-ceb9-40b9-94aa-9423d7d8a543 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048820 Sep 16 09:56:04.802674 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 378/753] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Sep 16 09:56:04 2022] GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:56:04.900031 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-88aa360e-9884-402e-8ace-310c881b92b8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:04.903027 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-88aa360e-9884-402e-8ace-310c881b92b8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:04.916701 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-88aa360e-9884-402e-8ace-310c881b92b8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:04.917390 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-88aa360e-9884-402e-8ace-310c881b92b8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:04.917956 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-88aa360e-9884-402e-8ace-310c881b92b8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:04.918791 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-88aa360e-9884-402e-8ace-310c881b92b8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:04.919408 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-88aa360e-9884-402e-8ace-310c881b92b8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:04.919958 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-88aa360e-9884-402e-8ace-310c881b92b8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:04.961650 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-88aa360e-9884-402e-8ace-310c881b92b8 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059011 Sep 16 09:56:04.961650 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 376/754] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Sep 16 09:56:04 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 09:56:05.037368 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-4ec209a6-aa2d-4c5c-a6dd-90495689abc6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:05.038101 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-4ec209a6-aa2d-4c5c-a6dd-90495689abc6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:05.044494 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4ec209a6-aa2d-4c5c-a6dd-90495689abc6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:05.045062 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4ec209a6-aa2d-4c5c-a6dd-90495689abc6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:05.045519 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4ec209a6-aa2d-4c5c-a6dd-90495689abc6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:05.046250 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4ec209a6-aa2d-4c5c-a6dd-90495689abc6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:05.046715 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4ec209a6-aa2d-4c5c-a6dd-90495689abc6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:05.047149 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4ec209a6-aa2d-4c5c-a6dd-90495689abc6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:05.072401 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-4ec209a6-aa2d-4c5c-a6dd-90495689abc6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Going to try to terminate instance {{(pid=127671) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 09:56:05.364701 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-4ec209a6-aa2d-4c5c-a6dd-90495689abc6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "DELETE /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa" status: 204 len: 0 microversion: 2.1 time: 0.333933 Sep 16 09:56:05.365293 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 379/755] 10.222.0.73 () {58 vars in 1239 bytes} [Fri Sep 16 09:56:05 2022] DELETE /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 09:56:05.373358 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-ff6a1c31-cc0c-4868-b1ec-ece80dca1e49 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:05.374073 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-ff6a1c31-cc0c-4868-b1ec-ece80dca1e49 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:05.380489 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ff6a1c31-cc0c-4868-b1ec-ece80dca1e49 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:05.381052 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ff6a1c31-cc0c-4868-b1ec-ece80dca1e49 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:05.381569 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ff6a1c31-cc0c-4868-b1ec-ece80dca1e49 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:05.382355 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ff6a1c31-cc0c-4868-b1ec-ece80dca1e49 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:05.382882 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ff6a1c31-cc0c-4868-b1ec-ece80dca1e49 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:05.383395 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ff6a1c31-cc0c-4868-b1ec-ece80dca1e49 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:05.616896 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-ff6a1c31-cc0c-4868-b1ec-ece80dca1e49 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:05.624574 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-ff6a1c31-cc0c-4868-b1ec-ece80dca1e49 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa" status: 200 len: 1689 microversion: 2.1 time: 0.255176 Sep 16 09:56:05.629817 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 377/756] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:05 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa => generated 1689 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:56:05.814524 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-ef7f30fc-c800-43ed-88e6-5d0d556528df tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:05.816769 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-ef7f30fc-c800-43ed-88e6-5d0d556528df tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: db7a1d44-25f8-48e4-a8b6-f6ea14a508cb] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:05.823198 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ef7f30fc-c800-43ed-88e6-5d0d556528df tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:05.823693 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ef7f30fc-c800-43ed-88e6-5d0d556528df tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:05.824132 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ef7f30fc-c800-43ed-88e6-5d0d556528df tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:05.824834 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ef7f30fc-c800-43ed-88e6-5d0d556528df tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:05.825300 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ef7f30fc-c800-43ed-88e6-5d0d556528df tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:05.825822 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ef7f30fc-c800-43ed-88e6-5d0d556528df tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:05.857262 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-ef7f30fc-c800-43ed-88e6-5d0d556528df tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047279 Sep 16 09:56:05.857926 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 380/757] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Sep 16 09:56:05 2022] GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:56:06.648730 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-02497cd9-5990-4be7-9af2-bbfb0d6bdd60 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:06.649355 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-02497cd9-5990-4be7-9af2-bbfb0d6bdd60 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:06.655831 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-02497cd9-5990-4be7-9af2-bbfb0d6bdd60 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:06.656334 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-02497cd9-5990-4be7-9af2-bbfb0d6bdd60 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:06.656760 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-02497cd9-5990-4be7-9af2-bbfb0d6bdd60 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:06.658064 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-02497cd9-5990-4be7-9af2-bbfb0d6bdd60 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:06.658535 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-02497cd9-5990-4be7-9af2-bbfb0d6bdd60 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:06.658967 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-02497cd9-5990-4be7-9af2-bbfb0d6bdd60 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:06.817802 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-02497cd9-5990-4be7-9af2-bbfb0d6bdd60 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:06.828330 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-02497cd9-5990-4be7-9af2-bbfb0d6bdd60 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa" status: 200 len: 1689 microversion: 2.1 time: 0.183439 Sep 16 09:56:06.831419 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 378/758] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:06 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa => generated 1689 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:56:06.870013 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-3a3ea962-364d-41d3-aac0-658b555b457b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:06.872689 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-3a3ea962-364d-41d3-aac0-658b555b457b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: db7a1d44-25f8-48e4-a8b6-f6ea14a508cb] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:06.878389 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [req-dfbe4525-f517-4e51-a36d-f9b107db5316 req-a1211a22-c82a-49fa-89c1-e8b22f38846e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a74942a9-2ed1-4058-b2f6-6def2204784a", "tag": "dedee03b-d367-4e51-b2cd-813deda5dc38"}]} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:56:06.882003 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3a3ea962-364d-41d3-aac0-658b555b457b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:06.882003 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3a3ea962-364d-41d3-aac0-658b555b457b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:06.882003 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3a3ea962-364d-41d3-aac0-658b555b457b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:06.882551 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3a3ea962-364d-41d3-aac0-658b555b457b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:06.883207 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3a3ea962-364d-41d3-aac0-658b555b457b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:06.883651 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3a3ea962-364d-41d3-aac0-658b555b457b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:06.888108 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-dfbe4525-f517-4e51-a36d-f9b107db5316 req-a1211a22-c82a-49fa-89c1-e8b22f38846e service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:06.888592 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-dfbe4525-f517-4e51-a36d-f9b107db5316 req-a1211a22-c82a-49fa-89c1-e8b22f38846e service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:06.889184 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-dfbe4525-f517-4e51-a36d-f9b107db5316 req-a1211a22-c82a-49fa-89c1-e8b22f38846e service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:06.903852 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.compute.server_external_events [req-dfbe4525-f517-4e51-a36d-f9b107db5316 req-a1211a22-c82a-49fa-89c1-e8b22f38846e service nova] Creating event network-changed:dedee03b-d367-4e51-b2cd-813deda5dc38 for instance a74942a9-2ed1-4058-b2f6-6def2204784a on hv-cinder-79053 Sep 16 09:56:06.910742 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [req-dfbe4525-f517-4e51-a36d-f9b107db5316 req-a1211a22-c82a-49fa-89c1-e8b22f38846e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109545 Sep 16 09:56:06.911838 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 381/759] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:56:06.916865 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-3a3ea962-364d-41d3-aac0-658b555b457b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050810 Sep 16 09:56:06.917862 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 379/760] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Sep 16 09:56:06 2022] GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 09:56:07.855441 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-9a969a05-c126-401d-a959-339b3314ee37 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:07.856063 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-9a969a05-c126-401d-a959-339b3314ee37 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:07.863380 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9a969a05-c126-401d-a959-339b3314ee37 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:07.863873 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9a969a05-c126-401d-a959-339b3314ee37 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:07.864319 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9a969a05-c126-401d-a959-339b3314ee37 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:07.865068 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9a969a05-c126-401d-a959-339b3314ee37 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:07.865530 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9a969a05-c126-401d-a959-339b3314ee37 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:07.865986 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9a969a05-c126-401d-a959-339b3314ee37 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:07.930611 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-cfafd23b-a411-491a-ba89-434f48be7b8f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:07.934188 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-cfafd23b-a411-491a-ba89-434f48be7b8f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: db7a1d44-25f8-48e4-a8b6-f6ea14a508cb] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:07.940894 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cfafd23b-a411-491a-ba89-434f48be7b8f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:07.941660 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cfafd23b-a411-491a-ba89-434f48be7b8f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:07.942484 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cfafd23b-a411-491a-ba89-434f48be7b8f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:07.943367 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cfafd23b-a411-491a-ba89-434f48be7b8f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:07.943974 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cfafd23b-a411-491a-ba89-434f48be7b8f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:07.944564 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cfafd23b-a411-491a-ba89-434f48be7b8f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:07.977242 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-cfafd23b-a411-491a-ba89-434f48be7b8f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050568 Sep 16 09:56:07.977852 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 380/761] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Sep 16 09:56:07 2022] GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:56:08.020939 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-9a969a05-c126-401d-a959-339b3314ee37 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:08.028795 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-9a969a05-c126-401d-a959-339b3314ee37 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa" status: 200 len: 1689 microversion: 2.1 time: 0.178283 Sep 16 09:56:08.029353 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 382/762] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:07 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa => generated 1689 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:56:08.990331 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-1bb6a15d-6b8e-4e21-8445-00d776ac8d23 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:08.992837 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-1bb6a15d-6b8e-4e21-8445-00d776ac8d23 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: db7a1d44-25f8-48e4-a8b6-f6ea14a508cb] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:08.999619 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1bb6a15d-6b8e-4e21-8445-00d776ac8d23 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:09.000110 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1bb6a15d-6b8e-4e21-8445-00d776ac8d23 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:09.000580 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1bb6a15d-6b8e-4e21-8445-00d776ac8d23 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:09.002190 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1bb6a15d-6b8e-4e21-8445-00d776ac8d23 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:09.002725 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1bb6a15d-6b8e-4e21-8445-00d776ac8d23 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:09.005692 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1bb6a15d-6b8e-4e21-8445-00d776ac8d23 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:09.035819 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-1bb6a15d-6b8e-4e21-8445-00d776ac8d23 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049292 Sep 16 09:56:09.036628 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 381/763] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Sep 16 09:56:08 2022] GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 09:56:09.052712 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-dafd2966-5d33-4470-8d10-db214d126a8d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:09.053329 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-dafd2966-5d33-4470-8d10-db214d126a8d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:09.059919 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-dafd2966-5d33-4470-8d10-db214d126a8d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:09.060409 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-dafd2966-5d33-4470-8d10-db214d126a8d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:09.060851 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-dafd2966-5d33-4470-8d10-db214d126a8d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:09.061670 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-dafd2966-5d33-4470-8d10-db214d126a8d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:09.062132 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-dafd2966-5d33-4470-8d10-db214d126a8d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:09.062556 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-dafd2966-5d33-4470-8d10-db214d126a8d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:09.116010 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-157e36b1-7c21-4183-976e-5679747d45f6 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:09.116990 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-157e36b1-7c21-4183-976e-5679747d45f6 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: db7a1d44-25f8-48e4-a8b6-f6ea14a508cb] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:09.124111 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-157e36b1-7c21-4183-976e-5679747d45f6 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:09.124668 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-157e36b1-7c21-4183-976e-5679747d45f6 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:09.130148 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-157e36b1-7c21-4183-976e-5679747d45f6 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:09.130148 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-157e36b1-7c21-4183-976e-5679747d45f6 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:09.130148 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-157e36b1-7c21-4183-976e-5679747d45f6 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:09.130148 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-157e36b1-7c21-4183-976e-5679747d45f6 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:09.166936 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-157e36b1-7c21-4183-976e-5679747d45f6 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: db7a1d44-25f8-48e4-a8b6-f6ea14a508cb] Going to try to terminate instance {{(pid=127670) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 09:56:09.265780 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-dafd2966-5d33-4470-8d10-db214d126a8d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:09.275659 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-dafd2966-5d33-4470-8d10-db214d126a8d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa" status: 200 len: 1689 microversion: 2.1 time: 0.226859 Sep 16 09:56:09.280495 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 383/764] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:09 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa => generated 1689 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:56:09.524982 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-157e36b1-7c21-4183-976e-5679747d45f6 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "DELETE /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb" status: 204 len: 0 microversion: 2.1 time: 0.417260 Sep 16 09:56:09.525697 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 382/765] 10.222.0.73 () {58 vars in 1239 bytes} [Fri Sep 16 09:56:09 2022] DELETE /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 09:56:09.534418 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-4f74c9b4-6437-4f0a-bf11-222416ef04e9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:09.535030 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-4f74c9b4-6437-4f0a-bf11-222416ef04e9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: db7a1d44-25f8-48e4-a8b6-f6ea14a508cb] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:09.541217 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4f74c9b4-6437-4f0a-bf11-222416ef04e9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:09.541733 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4f74c9b4-6437-4f0a-bf11-222416ef04e9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:09.542171 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4f74c9b4-6437-4f0a-bf11-222416ef04e9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:09.543563 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4f74c9b4-6437-4f0a-bf11-222416ef04e9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:09.543963 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4f74c9b4-6437-4f0a-bf11-222416ef04e9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:09.544392 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4f74c9b4-6437-4f0a-bf11-222416ef04e9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:09.556715 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-bdef58c6-75d0-425d-b63f-b4ddb406a2e5 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-181057337"}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:56:09.557353 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-bdef58c6-75d0-425d-b63f-b4ddb406a2e5 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:09.564311 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bdef58c6-75d0-425d-b63f-b4ddb406a2e5 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:09.565375 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bdef58c6-75d0-425d-b63f-b4ddb406a2e5 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:09.565799 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bdef58c6-75d0-425d-b63f-b4ddb406a2e5 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:09.566517 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bdef58c6-75d0-425d-b63f-b4ddb406a2e5 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:09.566982 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bdef58c6-75d0-425d-b63f-b4ddb406a2e5 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:09.567412 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bdef58c6-75d0-425d-b63f-b4ddb406a2e5 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:09.680561 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-4f74c9b4-6437-4f0a-bf11-222416ef04e9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:09.688961 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-4f74c9b4-6437-4f0a-bf11-222416ef04e9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb" status: 200 len: 1682 microversion: 2.1 time: 0.158392 Sep 16 09:56:09.689910 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 384/766] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:09 2022] GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:56:09.834778 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.network.security_group_api [None req-bdef58c6-75d0-425d-b63f-b4ddb406a2e5 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Adding security group ac5927e3-c811-4909-a073-19e742068fdc to port dedee03b-d367-4e51-b2cd-813deda5dc38 Sep 16 09:56:10.298923 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-74b8c737-0809-44f7-9af0-31fb93de5304 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:10.299679 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-74b8c737-0809-44f7-9af0-31fb93de5304 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:10.306182 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-74b8c737-0809-44f7-9af0-31fb93de5304 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:10.306751 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-74b8c737-0809-44f7-9af0-31fb93de5304 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:10.307292 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-74b8c737-0809-44f7-9af0-31fb93de5304 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:10.308072 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-74b8c737-0809-44f7-9af0-31fb93de5304 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:10.308610 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-74b8c737-0809-44f7-9af0-31fb93de5304 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:10.309114 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-74b8c737-0809-44f7-9af0-31fb93de5304 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:10.372239 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-74b8c737-0809-44f7-9af0-31fb93de5304 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:10.380513 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-74b8c737-0809-44f7-9af0-31fb93de5304 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa" status: 200 len: 1621 microversion: 2.1 time: 0.085527 Sep 16 09:56:10.381089 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 385/767] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:10 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa => generated 1621 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:56:10.422236 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-bdef58c6-75d0-425d-b63f-b4ddb406a2e5 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "POST /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a/action" status: 202 len: 0 microversion: 2.1 time: 0.869774 Sep 16 09:56:10.423645 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 383/768] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Sep 16 09:56:09 2022] POST /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a/action => generated 0 bytes in 872 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 09:56:10.432667 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-0865cff6-2c6a-4aa8-b10c-e8bf0f784e55 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:10.434873 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-0865cff6-2c6a-4aa8-b10c-e8bf0f784e55 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:10.441964 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-0865cff6-2c6a-4aa8-b10c-e8bf0f784e55 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:10.445883 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-0865cff6-2c6a-4aa8-b10c-e8bf0f784e55 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:10.445883 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-0865cff6-2c6a-4aa8-b10c-e8bf0f784e55 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:10.445883 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-0865cff6-2c6a-4aa8-b10c-e8bf0f784e55 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:10.445883 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-0865cff6-2c6a-4aa8-b10c-e8bf0f784e55 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:10.446275 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-0865cff6-2c6a-4aa8-b10c-e8bf0f784e55 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:10.453586 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-9465d513-ac45-42a1-98a5-cd24975235d4 req-7ef2f753-887a-4799-b2ee-bbb3bc8e0e39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a74942a9-2ed1-4058-b2f6-6def2204784a", "tag": "dedee03b-d367-4e51-b2cd-813deda5dc38"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:56:10.473656 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-9465d513-ac45-42a1-98a5-cd24975235d4 req-7ef2f753-887a-4799-b2ee-bbb3bc8e0e39 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:10.474602 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-9465d513-ac45-42a1-98a5-cd24975235d4 req-7ef2f753-887a-4799-b2ee-bbb3bc8e0e39 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:10.475565 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-9465d513-ac45-42a1-98a5-cd24975235d4 req-7ef2f753-887a-4799-b2ee-bbb3bc8e0e39 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:10.491558 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-9465d513-ac45-42a1-98a5-cd24975235d4 req-7ef2f753-887a-4799-b2ee-bbb3bc8e0e39 service nova] Creating event network-changed:dedee03b-d367-4e51-b2cd-813deda5dc38 for instance a74942a9-2ed1-4058-b2f6-6def2204784a on hv-cinder-79053 Sep 16 09:56:10.497388 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-9465d513-ac45-42a1-98a5-cd24975235d4 req-7ef2f753-887a-4799-b2ee-bbb3bc8e0e39 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048866 Sep 16 09:56:10.498519 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 384/769] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:56:10.656306 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-0865cff6-2c6a-4aa8-b10c-e8bf0f784e55 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b850cd7b216d4aab865886d20194f322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ebe25211ee4dcb887de8e0c9a03040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:10.668796 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-0865cff6-2c6a-4aa8-b10c-e8bf0f784e55 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a" status: 200 len: 1639 microversion: 2.1 time: 0.240229 Sep 16 09:56:10.669409 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 386/770] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:10 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a => generated 1639 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:56:10.714566 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-f4184012-3ed0-4e38-a849-f4e5e6dafb43 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:10.715993 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-f4184012-3ed0-4e38-a849-f4e5e6dafb43 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: db7a1d44-25f8-48e4-a8b6-f6ea14a508cb] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:10.723065 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f4184012-3ed0-4e38-a849-f4e5e6dafb43 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:10.725642 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f4184012-3ed0-4e38-a849-f4e5e6dafb43 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:10.726124 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f4184012-3ed0-4e38-a849-f4e5e6dafb43 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:10.727069 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f4184012-3ed0-4e38-a849-f4e5e6dafb43 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:10.727343 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f4184012-3ed0-4e38-a849-f4e5e6dafb43 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:10.727882 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f4184012-3ed0-4e38-a849-f4e5e6dafb43 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:10.883701 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f4184012-3ed0-4e38-a849-f4e5e6dafb43 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:10.893903 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-f4184012-3ed0-4e38-a849-f4e5e6dafb43 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb" status: 200 len: 1682 microversion: 2.1 time: 0.183627 Sep 16 09:56:10.894689 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 385/771] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:10 2022] GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb => generated 1682 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:56:11.406834 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-82424581-bd5c-4b67-a193-93fb1528f74e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:11.409257 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-82424581-bd5c-4b67-a193-93fb1528f74e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:11.415647 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-82424581-bd5c-4b67-a193-93fb1528f74e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:11.416237 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-82424581-bd5c-4b67-a193-93fb1528f74e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:11.416745 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-82424581-bd5c-4b67-a193-93fb1528f74e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:11.417531 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-82424581-bd5c-4b67-a193-93fb1528f74e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:11.418085 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-82424581-bd5c-4b67-a193-93fb1528f74e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:11.418872 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-82424581-bd5c-4b67-a193-93fb1528f74e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:11.455003 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-82424581-bd5c-4b67-a193-93fb1528f74e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:11.455504 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-82424581-bd5c-4b67-a193-93fb1528f74e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:11.455945 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-82424581-bd5c-4b67-a193-93fb1528f74e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:11.456530 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.objects.instance [None req-82424581-bd5c-4b67-a193-93fb1528f74e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lazy-loading 'fault' on Instance uuid bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa {{(pid=127671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 09:56:11.512643 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-82424581-bd5c-4b67-a193-93fb1528f74e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:11.520848 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-82424581-bd5c-4b67-a193-93fb1528f74e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa" status: 200 len: 1335 microversion: 2.1 time: 0.120435 Sep 16 09:56:11.521761 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 387/772] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:11 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa => generated 1335 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:56:11.917721 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-8066a5b6-d8c4-4b40-a624-6c936b849e49 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:11.918379 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-8066a5b6-d8c4-4b40-a624-6c936b849e49 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: db7a1d44-25f8-48e4-a8b6-f6ea14a508cb] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:11.926246 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8066a5b6-d8c4-4b40-a624-6c936b849e49 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:11.926840 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8066a5b6-d8c4-4b40-a624-6c936b849e49 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:11.927361 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8066a5b6-d8c4-4b40-a624-6c936b849e49 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:11.928157 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8066a5b6-d8c4-4b40-a624-6c936b849e49 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:11.928687 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8066a5b6-d8c4-4b40-a624-6c936b849e49 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:11.929193 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8066a5b6-d8c4-4b40-a624-6c936b849e49 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:12.475022 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-8066a5b6-d8c4-4b40-a624-6c936b849e49 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:12.483293 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-8066a5b6-d8c4-4b40-a624-6c936b849e49 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb" status: 200 len: 1682 microversion: 2.1 time: 0.569506 Sep 16 09:56:12.483868 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 386/773] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:11 2022] GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb => generated 1682 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:56:12.530850 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [req-774d0f22-9d41-4eb4-ae66-1b02ab61d557 req-d3a69832-9eba-4e4f-85d3-e65d7da38b5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa", "name": "network-vif-deleted", "tag": "6851d923-796f-41a3-a0d3-de42390996fa"}]} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:56:12.542448 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-774d0f22-9d41-4eb4-ae66-1b02ab61d557 req-d3a69832-9eba-4e4f-85d3-e65d7da38b5b service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:12.542964 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-774d0f22-9d41-4eb4-ae66-1b02ab61d557 req-d3a69832-9eba-4e4f-85d3-e65d7da38b5b service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:12.543397 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-774d0f22-9d41-4eb4-ae66-1b02ab61d557 req-d3a69832-9eba-4e4f-85d3-e65d7da38b5b service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:12.546875 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-1b747a76-93a4-4c4c-a7a3-c107b89e5f9f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:12.547753 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-1b747a76-93a4-4c4c-a7a3-c107b89e5f9f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:12.554888 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1b747a76-93a4-4c4c-a7a3-c107b89e5f9f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:12.563524 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1b747a76-93a4-4c4c-a7a3-c107b89e5f9f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:12.563524 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1b747a76-93a4-4c4c-a7a3-c107b89e5f9f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:12.563888 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.compute.server_external_events [req-774d0f22-9d41-4eb4-ae66-1b02ab61d557 req-d3a69832-9eba-4e4f-85d3-e65d7da38b5b service nova] Creating event network-vif-deleted:6851d923-796f-41a3-a0d3-de42390996fa for instance bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa on hv-cinder-79053 Sep 16 09:56:12.564045 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1b747a76-93a4-4c4c-a7a3-c107b89e5f9f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:12.564045 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1b747a76-93a4-4c4c-a7a3-c107b89e5f9f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:12.564045 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1b747a76-93a4-4c4c-a7a3-c107b89e5f9f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:12.564473 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [req-774d0f22-9d41-4eb4-ae66-1b02ab61d557 req-d3a69832-9eba-4e4f-85d3-e65d7da38b5b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034432 Sep 16 09:56:12.564473 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 388/774] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:56:12.573117 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.wsgi [None req-1b747a76-93a4-4c4c-a7a3-c107b89e5f9f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] HTTP exception thrown: Instance bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa could not be found. Sep 16 09:56:12.574925 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-1b747a76-93a4-4c4c-a7a3-c107b89e5f9f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Request method failure captured: Sep 16 09:56:12.574925 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: request: GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa HTTP/1.1 Sep 16 09:56:12.574925 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept: application/json Sep 16 09:56:12.574925 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Sep 16 09:56:12.574925 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Connection: close Sep 16 09:56:12.574925 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Length: 0 Sep 16 09:56:12.574925 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Type: application/json Sep 16 09:56:12.574925 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Host: 10.222.0.73 Sep 16 09:56:12.574925 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Sep 16 09:56:12.574925 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Sep 16 09:56:12.574925 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjJEbxR-3pAhLiwb3ckUO6s_con7PzqaMH7LIfbFMfWWksbJi1GgWKz99k_xTyog5rd5nWR-OSR9_6_XhX2Wo2YD5uM25GUSMoNymOY18MnkEv9j1oga2G7G47Yhfh-dJVj2X4Cf2GB-s6CbFgJzG7jcNz64ctztxMfjiQALnI2E37Lf0 Sep 16 09:56:12.574925 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Sep 16 09:56:12.574925 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Sep 16 09:56:12.574925 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Sep 16 09:56:12.574925 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Sep 16 09:56:12.574925 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Sep 16 09:56:12.574925 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Sep 16 09:56:12.574925 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Id: 3fe0d52d42324aa38182b47b3588b979 Sep 16 09:56:12.574925 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1278542283 Sep 16 09:56:12.574925 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Role: reader,member Sep 16 09:56:12.574925 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Roles: reader,member Sep 16 09:56:12.576413 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/3fe0d52d42324aa38182b47b3588b979"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_3fe0d52d42324aa38182b47b3588b979", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/3fe0d52d42324aa38182b47b3588b979"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/3fe0d52d42324aa38182b47b3588b979"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 09:56:12.576413 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1278542283 Sep 16 09:56:12.576413 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Id: 3fe0d52d42324aa38182b47b3588b979 Sep 16 09:56:12.576413 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1278542283 Sep 16 09:56:12.576413 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User: tempest-ServerRescueNegativeTestJSON-1278542283-project Sep 16 09:56:12.576413 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Sep 16 09:56:12.576413 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Sep 16 09:56:12.576413 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Id: 8d1ce0bdadbc48d2899c7cdded5acb5c Sep 16 09:56:12.576413 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1278542283-project Sep 16 09:56:12.576413 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: method: > Sep 16 09:56:12.576413 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: exception: Instance bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa could not be found. Sep 16 09:56:12.576413 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: action_args: {'id': 'bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa'} Sep 16 09:56:12.577178 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 09:56:12.577178 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:56:12.577178 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 09:56:12.577178 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 09:56:12.577178 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 09:56:12.577178 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 09:56:12.577178 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 09:56:12.577178 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 09:56:12.577178 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 09:56:12.577178 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 09:56:12.577178 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa could not be found. Sep 16 09:56:12.577178 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:56:12.577178 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:56:12.577178 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:56:12.577178 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:56:12.577178 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:56:12.577178 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:56:12.577178 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 09:56:12.577178 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 09:56:12.577178 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 09:56:12.578445 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:56:12.578445 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 09:56:12.578445 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 09:56:12.578445 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 09:56:12.578445 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 09:56:12.578445 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 09:56:12.578445 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 09:56:12.578445 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa could not be found. Sep 16 09:56:12.578445 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:56:12.578445 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:56:12.578445 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:56:12.578445 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:56:12.578445 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:56:12.578445 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:56:12.578445 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 09:56:12.578445 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 09:56:12.578445 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa could not be found. Sep 16 09:56:12.578445 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:56:12.580108 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-1b747a76-93a4-4c4c-a7a3-c107b89e5f9f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Returning 404 to user: Instance bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa could not be found. {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 09:56:12.580108 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-1b747a76-93a4-4c4c-a7a3-c107b89e5f9f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa" status: 404 len: 111 microversion: 2.1 time: 0.033967 Sep 16 09:56:12.580108 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 387/775] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:12 2022] GET /compute/v2.1/servers/bd1272b6-2b81-407d-b0fc-c9ce62d7c5aa => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 09:56:12.587655 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-bcb4e7e4-3c0b-4d46-8c60-5083afb885bb tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '.version_select at 0x7ffa6dac8790>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:12.686170 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-bcb4e7e4-3c0b-4d46-8c60-5083afb885bb tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1170594007" status: 202 len: 0 microversion: 2.1 time: 0.102841 Sep 16 09:56:12.686789 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 389/776] 10.222.0.73 () {58 vars in 1221 bytes} [Fri Sep 16 09:56:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1170594007 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 09:56:13.509151 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-f689f139-cce3-4e23-9bcd-f7c55df07fba tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:13.509802 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-f689f139-cce3-4e23-9bcd-f7c55df07fba tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: db7a1d44-25f8-48e4-a8b6-f6ea14a508cb] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:13.513169 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:56:13.518549 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f689f139-cce3-4e23-9bcd-f7c55df07fba tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:13.519351 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f689f139-cce3-4e23-9bcd-f7c55df07fba tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:13.519794 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f689f139-cce3-4e23-9bcd-f7c55df07fba tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:13.520492 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f689f139-cce3-4e23-9bcd-f7c55df07fba tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:13.520946 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f689f139-cce3-4e23-9bcd-f7c55df07fba tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:13.521367 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f689f139-cce3-4e23-9bcd-f7c55df07fba tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:13.554498 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f689f139-cce3-4e23-9bcd-f7c55df07fba tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:13.555246 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f689f139-cce3-4e23-9bcd-f7c55df07fba tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:13.555540 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f689f139-cce3-4e23-9bcd-f7c55df07fba tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:13.555998 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.objects.instance [None req-f689f139-cce3-4e23-9bcd-f7c55df07fba tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lazy-loading 'fault' on Instance uuid db7a1d44-25f8-48e4-a8b6-f6ea14a508cb {{(pid=127670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 09:56:13.602644 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f689f139-cce3-4e23-9bcd-f7c55df07fba tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:13.614772 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-f689f139-cce3-4e23-9bcd-f7c55df07fba tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb" status: 200 len: 1332 microversion: 2.1 time: 0.109791 Sep 16 09:56:13.617261 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 388/777] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:13 2022] GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb => generated 1332 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:56:14.598166 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [req-076fa6c9-a289-4466-a7ad-2e8595dfc683 req-17f09d8a-154f-4eb8-b0fb-2c05243aadb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db7a1d44-25f8-48e4-a8b6-f6ea14a508cb", "name": "network-vif-deleted", "tag": "8eda7ab4-bb91-4e39-a83a-f6278b385656"}]} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:56:14.608425 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-076fa6c9-a289-4466-a7ad-2e8595dfc683 req-17f09d8a-154f-4eb8-b0fb-2c05243aadb3 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:14.608899 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-076fa6c9-a289-4466-a7ad-2e8595dfc683 req-17f09d8a-154f-4eb8-b0fb-2c05243aadb3 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:14.609331 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-076fa6c9-a289-4466-a7ad-2e8595dfc683 req-17f09d8a-154f-4eb8-b0fb-2c05243aadb3 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:14.620230 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.compute.server_external_events [req-076fa6c9-a289-4466-a7ad-2e8595dfc683 req-17f09d8a-154f-4eb8-b0fb-2c05243aadb3 service nova] Creating event network-vif-deleted:8eda7ab4-bb91-4e39-a83a-f6278b385656 for instance db7a1d44-25f8-48e4-a8b6-f6ea14a508cb on hv-cinder-79053 Sep 16 09:56:14.625200 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [req-076fa6c9-a289-4466-a7ad-2e8595dfc683 req-17f09d8a-154f-4eb8-b0fb-2c05243aadb3 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031836 Sep 16 09:56:14.625906 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 390/778] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:56:14.646626 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-8ce042dd-1cc8-4f20-b994-1d2cd4b9e25e tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:14.647265 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-8ce042dd-1cc8-4f20-b994-1d2cd4b9e25e tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: db7a1d44-25f8-48e4-a8b6-f6ea14a508cb] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:14.653900 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8ce042dd-1cc8-4f20-b994-1d2cd4b9e25e tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:14.654380 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8ce042dd-1cc8-4f20-b994-1d2cd4b9e25e tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:14.654810 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8ce042dd-1cc8-4f20-b994-1d2cd4b9e25e tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:14.655490 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8ce042dd-1cc8-4f20-b994-1d2cd4b9e25e tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:14.655940 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8ce042dd-1cc8-4f20-b994-1d2cd4b9e25e tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:14.656363 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8ce042dd-1cc8-4f20-b994-1d2cd4b9e25e tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:14.670080 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.wsgi [None req-8ce042dd-1cc8-4f20-b994-1d2cd4b9e25e tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] HTTP exception thrown: Instance db7a1d44-25f8-48e4-a8b6-f6ea14a508cb could not be found. Sep 16 09:56:14.671559 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-8ce042dd-1cc8-4f20-b994-1d2cd4b9e25e tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Request method failure captured: Sep 16 09:56:14.671559 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: request: GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb HTTP/1.1 Sep 16 09:56:14.671559 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept: application/json Sep 16 09:56:14.671559 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Sep 16 09:56:14.671559 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Connection: close Sep 16 09:56:14.671559 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Length: 0 Sep 16 09:56:14.671559 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Type: application/json Sep 16 09:56:14.671559 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Host: 10.222.0.73 Sep 16 09:56:14.671559 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Sep 16 09:56:14.671559 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Sep 16 09:56:14.671559 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjJEbyIogtO-fgeLO9uv3_XXDwxtVD1eIMLN7x0Q3ZD4pj8hYAM6nbLEwKtYbBaube26iELy7B5lx0xTiRTzRgXZs50v25I7qfb15XuH_i9MG8_BlVJAG6OZoKZu6GI9c8evKltkWyTv3vVrhFavNaXN0ju9i-ZnFY6eOsWcD7CFugHvs Sep 16 09:56:14.671559 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Sep 16 09:56:14.671559 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Sep 16 09:56:14.671559 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Sep 16 09:56:14.671559 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Sep 16 09:56:14.671559 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Sep 16 09:56:14.671559 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Sep 16 09:56:14.671559 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Id: 75007587f92646f686881c2e1bfb7b2d Sep 16 09:56:14.671559 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-AttachVolumeNegativeTest-1478592665 Sep 16 09:56:14.671559 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Role: reader,member Sep 16 09:56:14.671559 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Roles: reader,member Sep 16 09:56:14.673135 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/75007587f92646f686881c2e1bfb7b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_75007587f92646f686881c2e1bfb7b2d", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/75007587f92646f686881c2e1bfb7b2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/75007587f92646f686881c2e1bfb7b2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 09:56:14.673135 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-AttachVolumeNegativeTest-1478592665 Sep 16 09:56:14.673135 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Id: 75007587f92646f686881c2e1bfb7b2d Sep 16 09:56:14.673135 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1478592665 Sep 16 09:56:14.673135 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User: tempest-AttachVolumeNegativeTest-1478592665-project Sep 16 09:56:14.673135 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Sep 16 09:56:14.673135 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Sep 16 09:56:14.673135 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Id: 7dca5726e89343828e25def6e6c274bb Sep 16 09:56:14.673135 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-AttachVolumeNegativeTest-1478592665-project Sep 16 09:56:14.673135 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: method: > Sep 16 09:56:14.673135 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: exception: Instance db7a1d44-25f8-48e4-a8b6-f6ea14a508cb could not be found. Sep 16 09:56:14.673135 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: action_args: {'id': 'db7a1d44-25f8-48e4-a8b6-f6ea14a508cb'} Sep 16 09:56:14.674050 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 09:56:14.674050 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:56:14.674050 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 09:56:14.674050 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 09:56:14.674050 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 09:56:14.674050 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 09:56:14.674050 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 09:56:14.674050 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 09:56:14.674050 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 09:56:14.674050 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 09:56:14.674050 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db7a1d44-25f8-48e4-a8b6-f6ea14a508cb could not be found. Sep 16 09:56:14.674050 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:56:14.674050 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:56:14.674050 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:56:14.674050 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:56:14.674050 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:56:14.674050 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:56:14.674050 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 09:56:14.674050 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 09:56:14.674050 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 09:56:14.675495 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:56:14.675495 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 09:56:14.675495 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 09:56:14.675495 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 09:56:14.675495 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 09:56:14.675495 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 09:56:14.675495 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 09:56:14.675495 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db7a1d44-25f8-48e4-a8b6-f6ea14a508cb could not be found. Sep 16 09:56:14.675495 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:56:14.675495 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:56:14.675495 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:56:14.675495 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:56:14.675495 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:56:14.675495 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:56:14.675495 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 09:56:14.675495 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 09:56:14.675495 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db7a1d44-25f8-48e4-a8b6-f6ea14a508cb could not be found. Sep 16 09:56:14.675495 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:56:14.676808 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-8ce042dd-1cc8-4f20-b994-1d2cd4b9e25e tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Returning 404 to user: Instance db7a1d44-25f8-48e4-a8b6-f6ea14a508cb could not be found. {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 09:56:14.676808 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-8ce042dd-1cc8-4f20-b994-1d2cd4b9e25e tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb" status: 404 len: 111 microversion: 2.1 time: 0.030543 Sep 16 09:56:14.676808 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 389/779] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:14 2022] GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 09:56:14.683234 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-e9a03661-7500-4fdd-b946-4d27dc586682 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '.version_select at 0x7ffa6daa45e0>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:14.759293 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-e9a03661-7500-4fdd-b946-4d27dc586682 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1054021645" status: 202 len: 0 microversion: 2.1 time: 0.080373 Sep 16 09:56:14.759876 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 391/780] 10.222.0.73 () {58 vars in 1221 bytes} [Fri Sep 16 09:56:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1054021645 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 09:56:15.554357 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-b5fa2268-8d8d-453c-a72d-27645b0b8da1 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Action: 'create', calling method: .version_select at 0x7ffa713c6f70>, body: {"keypair": {"name": "tempest-keypair-528630339", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEDbVXeS1VhbRbyndhibXTP8tT/SIOp09c3QQBMhFrdPhAg4tJbHo5yhe0pEqbk5En/rObPXYSZGJrIOYmnG/mHn6VMMaGRfNIwHUXBDklXMRoECEltCymdpDFgvTkDEow=="}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:56:15.571045 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-b5fa2268-8d8d-453c-a72d-27645b0b8da1 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Getting quotas for project 75007587f92646f686881c2e1bfb7b2d. Resources: {'key_pairs'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 09:56:15.575038 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-b5fa2268-8d8d-453c-a72d-27645b0b8da1 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Getting quotas for user 7dca5726e89343828e25def6e6c274bb and project 75007587f92646f686881c2e1bfb7b2d. Resources: {'key_pairs'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 09:56:15.705096 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-b5fa2268-8d8d-453c-a72d-27645b0b8da1 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.154973 Sep 16 09:56:15.705816 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 390/781] 10.222.0.73 () {60 vars in 1159 bytes} [Fri Sep 16 09:56:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:56:16.007611 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-c0bfb5fd-fc92-4e84-b1a9-b49460391bc3 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:16.008238 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-c0bfb5fd-fc92-4e84-b1a9-b49460391bc3 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:16.014465 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c0bfb5fd-fc92-4e84-b1a9-b49460391bc3 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:16.014956 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c0bfb5fd-fc92-4e84-b1a9-b49460391bc3 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:16.015523 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c0bfb5fd-fc92-4e84-b1a9-b49460391bc3 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:16.016991 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c0bfb5fd-fc92-4e84-b1a9-b49460391bc3 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:16.017470 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c0bfb5fd-fc92-4e84-b1a9-b49460391bc3 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:16.018540 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c0bfb5fd-fc92-4e84-b1a9-b49460391bc3 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:16.045526 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-c0bfb5fd-fc92-4e84-b1a9-b49460391bc3 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Going to try to terminate instance {{(pid=127671) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 09:56:16.273105 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-c0bfb5fd-fc92-4e84-b1a9-b49460391bc3 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "DELETE /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 204 len: 0 microversion: 2.1 time: 0.269783 Sep 16 09:56:16.273731 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 392/782] 10.222.0.73 () {58 vars in 1239 bytes} [Fri Sep 16 09:56:16 2022] DELETE /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 09:56:16.281828 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-61a57a9e-7d8b-4377-804d-ab3630c119ab tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:16.282926 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-61a57a9e-7d8b-4377-804d-ab3630c119ab tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:16.291059 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-61a57a9e-7d8b-4377-804d-ab3630c119ab tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:16.291864 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-61a57a9e-7d8b-4377-804d-ab3630c119ab tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:16.292431 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-61a57a9e-7d8b-4377-804d-ab3630c119ab tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:16.293154 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-61a57a9e-7d8b-4377-804d-ab3630c119ab tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:16.293681 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-61a57a9e-7d8b-4377-804d-ab3630c119ab tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:16.294116 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-61a57a9e-7d8b-4377-804d-ab3630c119ab tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:16.427204 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-61a57a9e-7d8b-4377-804d-ab3630c119ab tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:16.434842 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-61a57a9e-7d8b-4377-804d-ab3630c119ab tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1508 microversion: 2.1 time: 0.156882 Sep 16 09:56:16.435396 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 391/783] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:16 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:56:17.459757 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-5a4396ca-e3f9-42ed-ab91-7afee912f0e6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:17.461061 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-5a4396ca-e3f9-42ed-ab91-7afee912f0e6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:17.467813 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5a4396ca-e3f9-42ed-ab91-7afee912f0e6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:17.468311 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5a4396ca-e3f9-42ed-ab91-7afee912f0e6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:17.468750 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5a4396ca-e3f9-42ed-ab91-7afee912f0e6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:17.469463 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5a4396ca-e3f9-42ed-ab91-7afee912f0e6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:17.469950 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5a4396ca-e3f9-42ed-ab91-7afee912f0e6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:17.470378 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5a4396ca-e3f9-42ed-ab91-7afee912f0e6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:17.700756 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-5a4396ca-e3f9-42ed-ab91-7afee912f0e6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:17.709457 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-5a4396ca-e3f9-42ed-ab91-7afee912f0e6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1508 microversion: 2.1 time: 0.254025 Sep 16 09:56:17.709975 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 393/784] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:17 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1508 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:56:18.236114 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-c9c5e392-8e85-4b0f-ae08-428b57e2844d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1806393656", "imageRef": "30d28050-ec9d-4227-9bb0-5247430f6177", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b92b7908-54f3-4444-8e37-e6621fa07310"}], "security_groups": [{"name": "tempest-securitygroup--296174055"}], "key_name": "tempest-keypair-528630339", "user_data": "}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:56:18.340950 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.network.neutron [None req-c9c5e392-8e85-4b0f-ae08-428b57e2844d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] validate_networks() for [('b92b7908-54f3-4444-8e37-e6621fa07310', None, None, None, None, None)] {{(pid=127670) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 09:56:18.718101 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-c9c5e392-8e85-4b0f-ae08-428b57e2844d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Flavor limits 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 09:56:18.718534 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-c9c5e392-8e85-4b0f-ae08-428b57e2844d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Image limits 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 09:56:18.719035 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-c9c5e392-8e85-4b0f-ae08-428b57e2844d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Flavor pref 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 09:56:18.719700 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-c9c5e392-8e85-4b0f-ae08-428b57e2844d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Image pref 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 09:56:18.719871 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-c9c5e392-8e85-4b0f-ae08-428b57e2844d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 09:56:18.728922 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c9c5e392-8e85-4b0f-ae08-428b57e2844d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:18.729338 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c9c5e392-8e85-4b0f-ae08-428b57e2844d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:18.730060 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c9c5e392-8e85-4b0f-ae08-428b57e2844d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:18.730811 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c9c5e392-8e85-4b0f-ae08-428b57e2844d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:18.731271 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c9c5e392-8e85-4b0f-ae08-428b57e2844d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:18.731533 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-643ce247-9846-4371-9600-9305f6217f38 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:18.731985 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c9c5e392-8e85-4b0f-ae08-428b57e2844d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:18.732152 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-643ce247-9846-4371-9600-9305f6217f38 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:18.739120 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-643ce247-9846-4371-9600-9305f6217f38 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:18.739610 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-643ce247-9846-4371-9600-9305f6217f38 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:18.740053 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-643ce247-9846-4371-9600-9305f6217f38 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:18.740757 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-643ce247-9846-4371-9600-9305f6217f38 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:18.741229 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-643ce247-9846-4371-9600-9305f6217f38 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:18.741691 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-643ce247-9846-4371-9600-9305f6217f38 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:18.748862 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-c9c5e392-8e85-4b0f-ae08-428b57e2844d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Getting quotas for project 75007587f92646f686881c2e1bfb7b2d. Resources: {'instances', 'cores', 'ram'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 09:56:18.753405 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-c9c5e392-8e85-4b0f-ae08-428b57e2844d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Getting quotas for user 7dca5726e89343828e25def6e6c274bb and project 75007587f92646f686881c2e1bfb7b2d. Resources: {'instances', 'cores', 'ram'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 09:56:18.764393 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-c9c5e392-8e85-4b0f-ae08-428b57e2844d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Going to run 1 instances... {{(pid=127670) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 09:56:18.766814 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-c9c5e392-8e85-4b0f-ae08-428b57e2844d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 2842e80e-fd61-48cf-b415-c5513f6811df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='30d28050-ec9d-4227-9bb0-5247430f6177',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 09:56:18.873982 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-643ce247-9846-4371-9600-9305f6217f38 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:18.878768 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:56:18.883491 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-643ce247-9846-4371-9600-9305f6217f38 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1508 microversion: 2.1 time: 0.156060 Sep 16 09:56:18.884059 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 394/785] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:18 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:56:18.903639 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-c9c5e392-8e85-4b0f-ae08-428b57e2844d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.672007 Sep 16 09:56:18.904311 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 392/786] 10.222.0.73 () {60 vars in 1147 bytes} [Fri Sep 16 09:56:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 09:56:18.916660 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-7c713981-13e9-43f0-b3f7-6071ce6ae736 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:18.917268 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-7c713981-13e9-43f0-b3f7-6071ce6ae736 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 2842e80e-fd61-48cf-b415-c5513f6811df] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:18.974052 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-7c713981-13e9-43f0-b3f7-6071ce6ae736 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:18.982080 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-7c713981-13e9-43f0-b3f7-6071ce6ae736 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df" status: 200 len: 1241 microversion: 2.1 time: 0.069349 Sep 16 09:56:18.982972 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 395/787] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:18 2022] GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:56:19.906161 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d1743c9e-9164-4b38-b51e-44179010d59e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:19.906813 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-d1743c9e-9164-4b38-b51e-44179010d59e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:19.912718 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d1743c9e-9164-4b38-b51e-44179010d59e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:19.913198 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d1743c9e-9164-4b38-b51e-44179010d59e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:19.913660 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d1743c9e-9164-4b38-b51e-44179010d59e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:19.914344 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d1743c9e-9164-4b38-b51e-44179010d59e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:19.914794 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d1743c9e-9164-4b38-b51e-44179010d59e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:19.915215 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d1743c9e-9164-4b38-b51e-44179010d59e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:19.918340 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:56:20.007037 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-438e8803-39f0-4f3a-91fc-0111aa45c248 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:20.007656 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-438e8803-39f0-4f3a-91fc-0111aa45c248 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 2842e80e-fd61-48cf-b415-c5513f6811df] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:20.015086 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-438e8803-39f0-4f3a-91fc-0111aa45c248 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:20.018828 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-438e8803-39f0-4f3a-91fc-0111aa45c248 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:20.018828 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-438e8803-39f0-4f3a-91fc-0111aa45c248 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:20.018828 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-438e8803-39f0-4f3a-91fc-0111aa45c248 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:20.018828 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-438e8803-39f0-4f3a-91fc-0111aa45c248 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:20.019178 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-438e8803-39f0-4f3a-91fc-0111aa45c248 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:20.046875 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-d1743c9e-9164-4b38-b51e-44179010d59e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:20.055820 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-d1743c9e-9164-4b38-b51e-44179010d59e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1508 microversion: 2.1 time: 0.154085 Sep 16 09:56:20.056633 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 393/788] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:19 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:56:20.081641 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-438e8803-39f0-4f3a-91fc-0111aa45c248 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:20.090369 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-438e8803-39f0-4f3a-91fc-0111aa45c248 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df" status: 200 len: 1245 microversion: 2.1 time: 0.087214 Sep 16 09:56:20.090932 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 396/789] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:20 2022] GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:56:21.080532 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-3b6c367c-3125-4a4b-91cc-a0c5aefabd63 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:21.081300 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-3b6c367c-3125-4a4b-91cc-a0c5aefabd63 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:21.089143 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3b6c367c-3125-4a4b-91cc-a0c5aefabd63 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:21.089674 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3b6c367c-3125-4a4b-91cc-a0c5aefabd63 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:21.090124 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3b6c367c-3125-4a4b-91cc-a0c5aefabd63 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:21.090917 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3b6c367c-3125-4a4b-91cc-a0c5aefabd63 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:21.091608 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3b6c367c-3125-4a4b-91cc-a0c5aefabd63 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:21.092296 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3b6c367c-3125-4a4b-91cc-a0c5aefabd63 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:21.115207 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-de3e443e-1b48-467e-885b-614cc0baa6cc tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:21.116232 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-de3e443e-1b48-467e-885b-614cc0baa6cc tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 2842e80e-fd61-48cf-b415-c5513f6811df] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:21.125454 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-de3e443e-1b48-467e-885b-614cc0baa6cc tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:21.125980 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-de3e443e-1b48-467e-885b-614cc0baa6cc tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:21.127268 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-de3e443e-1b48-467e-885b-614cc0baa6cc tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:21.129339 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-de3e443e-1b48-467e-885b-614cc0baa6cc tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:21.130257 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-de3e443e-1b48-467e-885b-614cc0baa6cc tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:21.130860 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-de3e443e-1b48-467e-885b-614cc0baa6cc tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:21.222579 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-de3e443e-1b48-467e-885b-614cc0baa6cc tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:21.244996 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-de3e443e-1b48-467e-885b-614cc0baa6cc tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df" status: 200 len: 1293 microversion: 2.1 time: 0.134750 Sep 16 09:56:21.247090 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 397/790] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:21 2022] GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df => generated 1293 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:56:21.325300 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-3b6c367c-3125-4a4b-91cc-a0c5aefabd63 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:21.337195 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-3b6c367c-3125-4a4b-91cc-a0c5aefabd63 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1508 microversion: 2.1 time: 0.258400 Sep 16 09:56:21.349738 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 394/791] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:21 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1508 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:56:21.390435 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [req-fd38acdb-d5f0-4df7-85da-0725346c1fe4 req-047425a1-0f4e-45e6-8c30-e28b2b6adca4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6f3fc30-e196-4427-90b4-5d49b56a9b46", "name": "network-vif-deleted", "tag": "10ea483a-6487-40ad-8b75-adc32be4973b"}]} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:56:21.402991 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-fd38acdb-d5f0-4df7-85da-0725346c1fe4 req-047425a1-0f4e-45e6-8c30-e28b2b6adca4 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:21.403473 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-fd38acdb-d5f0-4df7-85da-0725346c1fe4 req-047425a1-0f4e-45e6-8c30-e28b2b6adca4 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:21.403913 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-fd38acdb-d5f0-4df7-85da-0725346c1fe4 req-047425a1-0f4e-45e6-8c30-e28b2b6adca4 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:21.415034 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.compute.server_external_events [req-fd38acdb-d5f0-4df7-85da-0725346c1fe4 req-047425a1-0f4e-45e6-8c30-e28b2b6adca4 service nova] Creating event network-vif-deleted:10ea483a-6487-40ad-8b75-adc32be4973b for instance a6f3fc30-e196-4427-90b4-5d49b56a9b46 on hv-cinder-79053 Sep 16 09:56:21.419919 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [req-fd38acdb-d5f0-4df7-85da-0725346c1fe4 req-047425a1-0f4e-45e6-8c30-e28b2b6adca4 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036209 Sep 16 09:56:21.420509 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 398/792] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:56:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:56:22.271966 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-45a82ef4-3551-4ef1-b3fd-fe6d04f326ca tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:22.272586 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-45a82ef4-3551-4ef1-b3fd-fe6d04f326ca tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 2842e80e-fd61-48cf-b415-c5513f6811df] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:22.279189 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-45a82ef4-3551-4ef1-b3fd-fe6d04f326ca tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:22.279685 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-45a82ef4-3551-4ef1-b3fd-fe6d04f326ca tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:22.280129 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-45a82ef4-3551-4ef1-b3fd-fe6d04f326ca tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:22.280836 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-45a82ef4-3551-4ef1-b3fd-fe6d04f326ca tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:22.281299 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-45a82ef4-3551-4ef1-b3fd-fe6d04f326ca tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:22.281763 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-45a82ef4-3551-4ef1-b3fd-fe6d04f326ca tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:22.361593 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-e76250c6-b435-48e4-ac1e-d1ea39f6d73d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:22.362294 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-e76250c6-b435-48e4-ac1e-d1ea39f6d73d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:22.368661 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e76250c6-b435-48e4-ac1e-d1ea39f6d73d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:22.369179 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e76250c6-b435-48e4-ac1e-d1ea39f6d73d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:22.370160 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e76250c6-b435-48e4-ac1e-d1ea39f6d73d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:22.370909 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e76250c6-b435-48e4-ac1e-d1ea39f6d73d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:22.371381 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e76250c6-b435-48e4-ac1e-d1ea39f6d73d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:22.371807 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e76250c6-b435-48e4-ac1e-d1ea39f6d73d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:22.372312 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-45a82ef4-3551-4ef1-b3fd-fe6d04f326ca tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:22.381775 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-45a82ef4-3551-4ef1-b3fd-fe6d04f326ca tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df" status: 200 len: 1299 microversion: 2.1 time: 0.114675 Sep 16 09:56:22.393564 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 395/793] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:22 2022] GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df => generated 1299 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:56:22.407789 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e76250c6-b435-48e4-ac1e-d1ea39f6d73d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:22.409458 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e76250c6-b435-48e4-ac1e-d1ea39f6d73d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:22.409933 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e76250c6-b435-48e4-ac1e-d1ea39f6d73d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:22.410390 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.objects.instance [None req-e76250c6-b435-48e4-ac1e-d1ea39f6d73d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lazy-loading 'fault' on Instance uuid a6f3fc30-e196-4427-90b4-5d49b56a9b46 {{(pid=127671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 09:56:22.453699 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-e76250c6-b435-48e4-ac1e-d1ea39f6d73d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:22.462174 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-e76250c6-b435-48e4-ac1e-d1ea39f6d73d tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1312 microversion: 2.1 time: 0.105337 Sep 16 09:56:22.465570 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 399/794] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:22 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1312 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:56:22.995552 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-461cdcc5-8008-45ea-8859-aa5951e0b861 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:22.996056 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-461cdcc5-8008-45ea-8859-aa5951e0b861 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:23.003406 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-461cdcc5-8008-45ea-8859-aa5951e0b861 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:23.003904 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-461cdcc5-8008-45ea-8859-aa5951e0b861 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:23.004352 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-461cdcc5-8008-45ea-8859-aa5951e0b861 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:23.005048 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-461cdcc5-8008-45ea-8859-aa5951e0b861 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:23.005512 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-461cdcc5-8008-45ea-8859-aa5951e0b861 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:23.005977 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-461cdcc5-8008-45ea-8859-aa5951e0b861 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:23.029209 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-461cdcc5-8008-45ea-8859-aa5951e0b861 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc/ips" status: 200 len: 152 microversion: 2.20 time: 0.037524 Sep 16 09:56:23.029840 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 396/795] 10.222.0.73 () {60 vars in 1289 bytes} [Fri Sep 16 09:56:22 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 09:56:23.405611 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-29cefde9-769f-4633-a734-f2dd8d35fd58 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:23.406225 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-29cefde9-769f-4633-a734-f2dd8d35fd58 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 2842e80e-fd61-48cf-b415-c5513f6811df] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:23.413495 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-29cefde9-769f-4633-a734-f2dd8d35fd58 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:23.414010 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-29cefde9-769f-4633-a734-f2dd8d35fd58 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:23.414451 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-29cefde9-769f-4633-a734-f2dd8d35fd58 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:23.415146 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-29cefde9-769f-4633-a734-f2dd8d35fd58 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:23.415711 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-29cefde9-769f-4633-a734-f2dd8d35fd58 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:23.416146 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-29cefde9-769f-4633-a734-f2dd8d35fd58 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:23.493209 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-cdd6e2e8-c54e-4b1f-8e1a-473ad6cd59ce tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:23.493984 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-cdd6e2e8-c54e-4b1f-8e1a-473ad6cd59ce tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:23.500629 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cdd6e2e8-c54e-4b1f-8e1a-473ad6cd59ce tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:23.501120 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cdd6e2e8-c54e-4b1f-8e1a-473ad6cd59ce tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:23.501572 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cdd6e2e8-c54e-4b1f-8e1a-473ad6cd59ce tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:23.502432 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cdd6e2e8-c54e-4b1f-8e1a-473ad6cd59ce tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:23.502888 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cdd6e2e8-c54e-4b1f-8e1a-473ad6cd59ce tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:23.503311 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cdd6e2e8-c54e-4b1f-8e1a-473ad6cd59ce tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:23.536040 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cdd6e2e8-c54e-4b1f-8e1a-473ad6cd59ce tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:23.536528 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cdd6e2e8-c54e-4b1f-8e1a-473ad6cd59ce tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:23.536963 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cdd6e2e8-c54e-4b1f-8e1a-473ad6cd59ce tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:23.537475 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.objects.instance [None req-cdd6e2e8-c54e-4b1f-8e1a-473ad6cd59ce tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lazy-loading 'fault' on Instance uuid a6f3fc30-e196-4427-90b4-5d49b56a9b46 {{(pid=127670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 09:56:23.550290 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-29cefde9-769f-4633-a734-f2dd8d35fd58 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:23.559758 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-29cefde9-769f-4633-a734-f2dd8d35fd58 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df" status: 200 len: 1366 microversion: 2.1 time: 0.158003 Sep 16 09:56:23.571672 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 400/796] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:23 2022] GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:56:23.589607 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-cdd6e2e8-c54e-4b1f-8e1a-473ad6cd59ce tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:23.598409 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-cdd6e2e8-c54e-4b1f-8e1a-473ad6cd59ce tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1312 microversion: 2.1 time: 0.109150 Sep 16 09:56:23.598982 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 397/797] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:23 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1312 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:56:24.583197 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-0370cfcf-4016-4ae4-b4b3-a23153e23a67 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:24.583805 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-0370cfcf-4016-4ae4-b4b3-a23153e23a67 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 2842e80e-fd61-48cf-b415-c5513f6811df] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:24.590455 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-0370cfcf-4016-4ae4-b4b3-a23153e23a67 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:24.590950 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-0370cfcf-4016-4ae4-b4b3-a23153e23a67 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:24.591391 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-0370cfcf-4016-4ae4-b4b3-a23153e23a67 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:24.592114 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-0370cfcf-4016-4ae4-b4b3-a23153e23a67 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:24.592673 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-0370cfcf-4016-4ae4-b4b3-a23153e23a67 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:24.593108 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-0370cfcf-4016-4ae4-b4b3-a23153e23a67 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:24.623118 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-04dd4c80-8aef-482c-aec0-f29738dd7df6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:24.624381 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-04dd4c80-8aef-482c-aec0-f29738dd7df6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:24.644840 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-04dd4c80-8aef-482c-aec0-f29738dd7df6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:24.645343 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-04dd4c80-8aef-482c-aec0-f29738dd7df6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:24.655199 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-04dd4c80-8aef-482c-aec0-f29738dd7df6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:24.656200 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-04dd4c80-8aef-482c-aec0-f29738dd7df6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:24.657436 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-04dd4c80-8aef-482c-aec0-f29738dd7df6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:24.661317 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-04dd4c80-8aef-482c-aec0-f29738dd7df6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:24.731456 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-04dd4c80-8aef-482c-aec0-f29738dd7df6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:24.731989 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-04dd4c80-8aef-482c-aec0-f29738dd7df6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:24.732547 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-04dd4c80-8aef-482c-aec0-f29738dd7df6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:24.733025 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.objects.instance [None req-04dd4c80-8aef-482c-aec0-f29738dd7df6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lazy-loading 'fault' on Instance uuid a6f3fc30-e196-4427-90b4-5d49b56a9b46 {{(pid=127670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 09:56:24.782181 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-0370cfcf-4016-4ae4-b4b3-a23153e23a67 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:24.790958 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-0370cfcf-4016-4ae4-b4b3-a23153e23a67 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df" status: 200 len: 1366 microversion: 2.1 time: 0.211827 Sep 16 09:56:24.791153 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-04dd4c80-8aef-482c-aec0-f29738dd7df6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:24.792018 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 401/798] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:24 2022] GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:56:24.799966 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-04dd4c80-8aef-482c-aec0-f29738dd7df6 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 200 len: 1312 microversion: 2.1 time: 0.181206 Sep 16 09:56:24.800816 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 398/799] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:24 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 1312 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:56:25.513670 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [req-a760b62f-23cb-4ad5-9e07-cf80b665f346 req-7f4c283e-b760-4e56-bf82-46d2750004c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2842e80e-fd61-48cf-b415-c5513f6811df", "tag": "d77fbe69-b931-4dfb-ac17-d581d7f6781e"}]} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:56:25.524038 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-a760b62f-23cb-4ad5-9e07-cf80b665f346 req-7f4c283e-b760-4e56-bf82-46d2750004c7 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:25.524522 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-a760b62f-23cb-4ad5-9e07-cf80b665f346 req-7f4c283e-b760-4e56-bf82-46d2750004c7 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:25.524956 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-a760b62f-23cb-4ad5-9e07-cf80b665f346 req-7f4c283e-b760-4e56-bf82-46d2750004c7 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:25.536106 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.compute.server_external_events [req-a760b62f-23cb-4ad5-9e07-cf80b665f346 req-7f4c283e-b760-4e56-bf82-46d2750004c7 service nova] Creating event network-changed:d77fbe69-b931-4dfb-ac17-d581d7f6781e for instance 2842e80e-fd61-48cf-b415-c5513f6811df on hv-cinder-79053 Sep 16 09:56:25.541135 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [req-a760b62f-23cb-4ad5-9e07-cf80b665f346 req-7f4c283e-b760-4e56-bf82-46d2750004c7 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031253 Sep 16 09:56:25.541770 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 402/800] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:56:25.813907 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-e5313d54-65ad-4269-902e-2c0118fc2e6c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:25.815503 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-e5313d54-65ad-4269-902e-2c0118fc2e6c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 2842e80e-fd61-48cf-b415-c5513f6811df] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:25.825097 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-8e05f3fc-1194-46a7-a4c9-0348485fc01f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:25.825872 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-8e05f3fc-1194-46a7-a4c9-0348485fc01f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: a6f3fc30-e196-4427-90b4-5d49b56a9b46] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:25.826377 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e5313d54-65ad-4269-902e-2c0118fc2e6c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:25.826866 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e5313d54-65ad-4269-902e-2c0118fc2e6c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:25.827459 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e5313d54-65ad-4269-902e-2c0118fc2e6c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:25.828002 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e5313d54-65ad-4269-902e-2c0118fc2e6c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:25.828477 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e5313d54-65ad-4269-902e-2c0118fc2e6c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:25.828898 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e5313d54-65ad-4269-902e-2c0118fc2e6c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:25.833722 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8e05f3fc-1194-46a7-a4c9-0348485fc01f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:25.834446 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8e05f3fc-1194-46a7-a4c9-0348485fc01f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:25.836151 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8e05f3fc-1194-46a7-a4c9-0348485fc01f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:25.836151 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8e05f3fc-1194-46a7-a4c9-0348485fc01f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:25.836151 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8e05f3fc-1194-46a7-a4c9-0348485fc01f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:25.836483 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8e05f3fc-1194-46a7-a4c9-0348485fc01f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:25.850332 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.wsgi [None req-8e05f3fc-1194-46a7-a4c9-0348485fc01f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] HTTP exception thrown: Instance a6f3fc30-e196-4427-90b4-5d49b56a9b46 could not be found. Sep 16 09:56:25.852201 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-8e05f3fc-1194-46a7-a4c9-0348485fc01f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Request method failure captured: Sep 16 09:56:25.852201 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: request: GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 HTTP/1.1 Sep 16 09:56:25.852201 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept: application/json Sep 16 09:56:25.852201 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept-Encoding: identity Sep 16 09:56:25.852201 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Connection: close Sep 16 09:56:25.852201 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Length: 0 Sep 16 09:56:25.852201 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Type: application/json Sep 16 09:56:25.852201 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Host: 10.222.0.73 Sep 16 09:56:25.852201 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Openstack-System-Scope: None Sep 16 09:56:25.852201 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: User-Agent: python-urllib3/1.26.12 Sep 16 09:56:25.852201 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Auth-Token: gAAAAABjJEbxR-3pAhLiwb3ckUO6s_con7PzqaMH7LIfbFMfWWksbJi1GgWKz99k_xTyog5rd5nWR-OSR9_6_XhX2Wo2YD5uM25GUSMoNymOY18MnkEv9j1oga2G7G47Yhfh-dJVj2X4Cf2GB-s6CbFgJzG7jcNz64ctztxMfjiQALnI2E37Lf0 Sep 16 09:56:25.852201 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Id: None Sep 16 09:56:25.852201 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Name: None Sep 16 09:56:25.852201 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Identity-Status: Confirmed Sep 16 09:56:25.852201 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Is-Admin-Project: True Sep 16 09:56:25.852201 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Id: default Sep 16 09:56:25.852201 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Name: Default Sep 16 09:56:25.852201 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Id: 3fe0d52d42324aa38182b47b3588b979 Sep 16 09:56:25.852201 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1278542283 Sep 16 09:56:25.852201 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Role: reader,member Sep 16 09:56:25.852201 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Roles: reader,member Sep 16 09:56:25.854121 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/3fe0d52d42324aa38182b47b3588b979"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_3fe0d52d42324aa38182b47b3588b979", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/3fe0d52d42324aa38182b47b3588b979"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/3fe0d52d42324aa38182b47b3588b979"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 09:56:25.854121 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1278542283 Sep 16 09:56:25.854121 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Id: 3fe0d52d42324aa38182b47b3588b979 Sep 16 09:56:25.854121 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1278542283 Sep 16 09:56:25.854121 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User: tempest-ServerRescueNegativeTestJSON-1278542283-project Sep 16 09:56:25.854121 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Id: default Sep 16 09:56:25.854121 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Name: Default Sep 16 09:56:25.854121 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Id: 8d1ce0bdadbc48d2899c7cdded5acb5c Sep 16 09:56:25.854121 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1278542283-project Sep 16 09:56:25.854121 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: method: > Sep 16 09:56:25.854121 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: exception: Instance a6f3fc30-e196-4427-90b4-5d49b56a9b46 could not be found. Sep 16 09:56:25.854121 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: action_args: {'id': 'a6f3fc30-e196-4427-90b4-5d49b56a9b46'} Sep 16 09:56:25.855210 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 09:56:25.855210 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:56:25.855210 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 09:56:25.855210 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 09:56:25.855210 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 09:56:25.855210 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 09:56:25.855210 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 09:56:25.855210 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 09:56:25.855210 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 09:56:25.855210 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 09:56:25.855210 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6f3fc30-e196-4427-90b4-5d49b56a9b46 could not be found. Sep 16 09:56:25.855210 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:56:25.855210 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:56:25.855210 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:56:25.855210 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:56:25.855210 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:56:25.855210 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:56:25.855210 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 09:56:25.855210 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 09:56:25.855210 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 09:56:25.856566 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:56:25.856566 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 09:56:25.856566 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 09:56:25.856566 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 09:56:25.856566 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 09:56:25.856566 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 09:56:25.856566 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 09:56:25.856566 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6f3fc30-e196-4427-90b4-5d49b56a9b46 could not be found. Sep 16 09:56:25.856566 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:56:25.856566 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:56:25.856566 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:56:25.856566 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:56:25.856566 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:56:25.856566 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:56:25.856566 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 09:56:25.856566 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 09:56:25.856566 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6f3fc30-e196-4427-90b4-5d49b56a9b46 could not be found. Sep 16 09:56:25.856566 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:56:25.857787 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-8e05f3fc-1194-46a7-a4c9-0348485fc01f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Returning 404 to user: Instance a6f3fc30-e196-4427-90b4-5d49b56a9b46 could not be found. {{(pid=127671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 09:56:25.857787 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-8e05f3fc-1194-46a7-a4c9-0348485fc01f tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46" status: 404 len: 111 microversion: 2.1 time: 0.033235 Sep 16 09:56:25.857787 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 403/801] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:25 2022] GET /compute/v2.1/servers/a6f3fc30-e196-4427-90b4-5d49b56a9b46 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 09:56:25.864889 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-a4867297-6b71-46c2-abf4-2577d9cbee1e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:25.865681 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-a4867297-6b71-46c2-abf4-2577d9cbee1e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: f634aa6d-e24c-48df-946f-3166fd76273a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:25.871320 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:56:25.872978 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a4867297-6b71-46c2-abf4-2577d9cbee1e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:25.873671 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a4867297-6b71-46c2-abf4-2577d9cbee1e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:25.874313 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a4867297-6b71-46c2-abf4-2577d9cbee1e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:25.875055 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a4867297-6b71-46c2-abf4-2577d9cbee1e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:25.875520 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a4867297-6b71-46c2-abf4-2577d9cbee1e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:25.875955 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a4867297-6b71-46c2-abf4-2577d9cbee1e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:25.903985 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-a4867297-6b71-46c2-abf4-2577d9cbee1e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: f634aa6d-e24c-48df-946f-3166fd76273a] Going to try to terminate instance {{(pid=127671) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 09:56:26.071921 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-e5313d54-65ad-4269-902e-2c0118fc2e6c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:26.079466 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-e5313d54-65ad-4269-902e-2c0118fc2e6c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df" status: 200 len: 1366 microversion: 2.1 time: 0.269555 Sep 16 09:56:26.080797 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 399/802] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:25 2022] GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df => generated 1366 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:56:26.232746 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-a4867297-6b71-46c2-abf4-2577d9cbee1e tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "DELETE /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a" status: 204 len: 0 microversion: 2.1 time: 0.373776 Sep 16 09:56:26.233624 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 404/803] 10.222.0.73 () {58 vars in 1239 bytes} [Fri Sep 16 09:56:25 2022] DELETE /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 09:56:26.242136 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-404fd592-7821-4d2f-8fa3-e95e4bed2750 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:26.242750 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-404fd592-7821-4d2f-8fa3-e95e4bed2750 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: f634aa6d-e24c-48df-946f-3166fd76273a] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:26.250387 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-404fd592-7821-4d2f-8fa3-e95e4bed2750 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:26.250387 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-404fd592-7821-4d2f-8fa3-e95e4bed2750 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:26.250387 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-404fd592-7821-4d2f-8fa3-e95e4bed2750 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:26.250777 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-404fd592-7821-4d2f-8fa3-e95e4bed2750 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:26.250936 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-404fd592-7821-4d2f-8fa3-e95e4bed2750 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:26.251358 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-404fd592-7821-4d2f-8fa3-e95e4bed2750 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:26.401712 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-404fd592-7821-4d2f-8fa3-e95e4bed2750 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:26.409505 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-404fd592-7821-4d2f-8fa3-e95e4bed2750 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a" status: 200 len: 1522 microversion: 2.1 time: 0.171290 Sep 16 09:56:26.410087 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 400/804] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:26 2022] GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:56:26.855496 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-b1cb1ed6-16dc-49b5-b885-7a91febd6d61 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:56:26.856111 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-b1cb1ed6-16dc-49b5-b885-7a91febd6d61 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:26.863315 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b1cb1ed6-16dc-49b5-b885-7a91febd6d61 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:26.863794 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b1cb1ed6-16dc-49b5-b885-7a91febd6d61 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:26.864228 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b1cb1ed6-16dc-49b5-b885-7a91febd6d61 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:26.864912 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b1cb1ed6-16dc-49b5-b885-7a91febd6d61 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:26.865362 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b1cb1ed6-16dc-49b5-b885-7a91febd6d61 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:26.865810 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b1cb1ed6-16dc-49b5-b885-7a91febd6d61 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:26.888934 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.objects.instance [None req-b1cb1ed6-16dc-49b5-b885-7a91febd6d61 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lazy-loading 'flavor' on Instance uuid e0f4a754-d9db-4829-a2f8-677cc9c34fbc {{(pid=127671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 09:56:27.109986 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-ad511917-4fbd-4159-81e1-f73be7ac60eb tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:27.110674 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-ad511917-4fbd-4159-81e1-f73be7ac60eb tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 2842e80e-fd61-48cf-b415-c5513f6811df] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:27.119508 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ad511917-4fbd-4159-81e1-f73be7ac60eb tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:27.120116 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ad511917-4fbd-4159-81e1-f73be7ac60eb tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:27.120650 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ad511917-4fbd-4159-81e1-f73be7ac60eb tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:27.121396 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ad511917-4fbd-4159-81e1-f73be7ac60eb tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:27.122002 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ad511917-4fbd-4159-81e1-f73be7ac60eb tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:27.122441 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ad511917-4fbd-4159-81e1-f73be7ac60eb tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:27.263946 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-ad511917-4fbd-4159-81e1-f73be7ac60eb tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:27.273001 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-ad511917-4fbd-4159-81e1-f73be7ac60eb tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df" status: 200 len: 1366 microversion: 2.1 time: 0.166939 Sep 16 09:56:27.273647 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 401/805] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:27 2022] GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:56:27.339890 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-b1cb1ed6-16dc-49b5-b885-7a91febd6d61 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "POST /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc/action" status: 202 len: 0 microversion: 2.20 time: 0.488768 Sep 16 09:56:27.340486 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 405/806] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Sep 16 09:56:26 2022] POST /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc/action => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 16 09:56:27.352097 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-2e81ad90-d017-4e09-98e0-add67cbec814 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:27.352757 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-2e81ad90-d017-4e09-98e0-add67cbec814 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:27.358907 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2e81ad90-d017-4e09-98e0-add67cbec814 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:27.359394 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2e81ad90-d017-4e09-98e0-add67cbec814 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:27.359834 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2e81ad90-d017-4e09-98e0-add67cbec814 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:27.360575 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2e81ad90-d017-4e09-98e0-add67cbec814 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:27.361832 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2e81ad90-d017-4e09-98e0-add67cbec814 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:27.362393 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2e81ad90-d017-4e09-98e0-add67cbec814 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:27.432764 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-e88d2e65-1882-4afe-8c94-23f385677dcf tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:27.433682 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-e88d2e65-1882-4afe-8c94-23f385677dcf tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: f634aa6d-e24c-48df-946f-3166fd76273a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:27.440228 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e88d2e65-1882-4afe-8c94-23f385677dcf tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:27.440719 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e88d2e65-1882-4afe-8c94-23f385677dcf tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:27.441157 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e88d2e65-1882-4afe-8c94-23f385677dcf tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:27.441875 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e88d2e65-1882-4afe-8c94-23f385677dcf tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:27.442331 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e88d2e65-1882-4afe-8c94-23f385677dcf tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:27.442750 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e88d2e65-1882-4afe-8c94-23f385677dcf tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:27.499412 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-2e81ad90-d017-4e09-98e0-add67cbec814 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:27.507818 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-2e81ad90-d017-4e09-98e0-add67cbec814 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:27.509305 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-2e81ad90-d017-4e09-98e0-add67cbec814 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:27.510553 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-2e81ad90-d017-4e09-98e0-add67cbec814 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1723 microversion: 2.20 time: 0.162555 Sep 16 09:56:27.511121 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 402/807] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:56:27 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:56:27.586220 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-e88d2e65-1882-4afe-8c94-23f385677dcf tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:27.594180 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-e88d2e65-1882-4afe-8c94-23f385677dcf tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a" status: 200 len: 1522 microversion: 2.1 time: 0.165692 Sep 16 09:56:27.594754 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 406/808] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:27 2022] GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:56:28.296614 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-63866ad6-7d32-4e81-abb6-3847232d0aa0 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:28.297097 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-63866ad6-7d32-4e81-abb6-3847232d0aa0 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 2842e80e-fd61-48cf-b415-c5513f6811df] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:28.304804 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-63866ad6-7d32-4e81-abb6-3847232d0aa0 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:28.305300 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-63866ad6-7d32-4e81-abb6-3847232d0aa0 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:28.305779 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-63866ad6-7d32-4e81-abb6-3847232d0aa0 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:28.306490 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-63866ad6-7d32-4e81-abb6-3847232d0aa0 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:28.306962 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-63866ad6-7d32-4e81-abb6-3847232d0aa0 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:28.307391 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-63866ad6-7d32-4e81-abb6-3847232d0aa0 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:28.438786 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-63866ad6-7d32-4e81-abb6-3847232d0aa0 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:28.447166 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-63866ad6-7d32-4e81-abb6-3847232d0aa0 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df" status: 200 len: 1366 microversion: 2.1 time: 0.154916 Sep 16 09:56:28.447754 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 403/809] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:28 2022] GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:56:28.537816 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-a57d4516-693a-4540-8b38-e8cf566a2469 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:28.538566 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-a57d4516-693a-4540-8b38-e8cf566a2469 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:28.544981 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a57d4516-693a-4540-8b38-e8cf566a2469 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:28.545477 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a57d4516-693a-4540-8b38-e8cf566a2469 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:28.545951 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a57d4516-693a-4540-8b38-e8cf566a2469 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:28.546642 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a57d4516-693a-4540-8b38-e8cf566a2469 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:28.547118 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a57d4516-693a-4540-8b38-e8cf566a2469 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:28.547527 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a57d4516-693a-4540-8b38-e8cf566a2469 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:28.619321 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-080ececd-f7a0-4129-af76-8de7f90669ba tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:28.620164 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-080ececd-f7a0-4129-af76-8de7f90669ba tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: f634aa6d-e24c-48df-946f-3166fd76273a] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:28.627099 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-080ececd-f7a0-4129-af76-8de7f90669ba tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:28.627836 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-080ececd-f7a0-4129-af76-8de7f90669ba tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:28.628431 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-080ececd-f7a0-4129-af76-8de7f90669ba tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:28.629196 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-080ececd-f7a0-4129-af76-8de7f90669ba tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:28.629681 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-080ececd-f7a0-4129-af76-8de7f90669ba tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:28.630117 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-080ececd-f7a0-4129-af76-8de7f90669ba tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:28.683047 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-a57d4516-693a-4540-8b38-e8cf566a2469 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:28.692341 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-a57d4516-693a-4540-8b38-e8cf566a2469 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:28.693747 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-a57d4516-693a-4540-8b38-e8cf566a2469 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:28.695126 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-a57d4516-693a-4540-8b38-e8cf566a2469 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1723 microversion: 2.20 time: 0.162743 Sep 16 09:56:28.695915 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 407/810] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:56:28 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:56:28.740212 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell0:SELECT=2 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:56:28.759823 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell0:SELECT=10 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:56:28.764898 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-080ececd-f7a0-4129-af76-8de7f90669ba tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:28.773478 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-080ececd-f7a0-4129-af76-8de7f90669ba tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a" status: 200 len: 1522 microversion: 2.1 time: 0.158309 Sep 16 09:56:28.774076 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 404/811] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:28 2022] GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:56:29.347314 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-5b0e77f4-ccfc-4545-8d80-4fc297f06af9 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:29.347823 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-5b0e77f4-ccfc-4545-8d80-4fc297f06af9 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] [instance: 8d0bc242-3744-4992-b1e3-819d84c53e50] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:29.349823 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell0:SELECT=2 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:56:29.354867 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5b0e77f4-ccfc-4545-8d80-4fc297f06af9 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:29.360593 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5b0e77f4-ccfc-4545-8d80-4fc297f06af9 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:29.360593 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5b0e77f4-ccfc-4545-8d80-4fc297f06af9 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:29.360593 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5b0e77f4-ccfc-4545-8d80-4fc297f06af9 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:29.360593 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5b0e77f4-ccfc-4545-8d80-4fc297f06af9 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:29.361724 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5b0e77f4-ccfc-4545-8d80-4fc297f06af9 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:29.438701 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.objects.instance [None req-5b0e77f4-ccfc-4545-8d80-4fc297f06af9 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lazy-loading 'services' on Instance uuid 8d0bc242-3744-4992-b1e3-819d84c53e50 {{(pid=127671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 09:56:29.475515 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-e22662da-5aaa-4789-86d8-11564367a24d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:29.476126 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-e22662da-5aaa-4789-86d8-11564367a24d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 2842e80e-fd61-48cf-b415-c5513f6811df] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:29.483527 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e22662da-5aaa-4789-86d8-11564367a24d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:29.484012 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e22662da-5aaa-4789-86d8-11564367a24d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:29.484441 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e22662da-5aaa-4789-86d8-11564367a24d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:29.485123 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e22662da-5aaa-4789-86d8-11564367a24d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:29.485592 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e22662da-5aaa-4789-86d8-11564367a24d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:29.486707 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e22662da-5aaa-4789-86d8-11564367a24d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:29.618264 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-e22662da-5aaa-4789-86d8-11564367a24d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:29.626000 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-e22662da-5aaa-4789-86d8-11564367a24d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df" status: 200 len: 1366 microversion: 2.1 time: 0.154536 Sep 16 09:56:29.626561 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 405/812] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:29 2022] GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:56:29.655031 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-5b0e77f4-ccfc-4545-8d80-4fc297f06af9 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] 10.222.0.73 "DELETE /compute/v2.1/servers/8d0bc242-3744-4992-b1e3-819d84c53e50/os-volume_attachments/00ae4bdd-6443-4836-ae4f-a5fb61672720" status: 202 len: 0 microversion: 2.1 time: 0.312619 Sep 16 09:56:29.655648 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 408/813] 10.222.0.73 () {58 vars in 1416 bytes} [Fri Sep 16 09:56:29 2022] DELETE /compute/v2.1/servers/8d0bc242-3744-4992-b1e3-819d84c53e50/os-volume_attachments/00ae4bdd-6443-4836-ae4f-a5fb61672720 => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 09:56:29.720334 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-862d23ee-74a8-40fd-82e0-62b95a0deb53 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:29.721077 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-862d23ee-74a8-40fd-82e0-62b95a0deb53 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:29.728204 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-862d23ee-74a8-40fd-82e0-62b95a0deb53 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:29.728695 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-862d23ee-74a8-40fd-82e0-62b95a0deb53 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:29.729395 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-862d23ee-74a8-40fd-82e0-62b95a0deb53 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:29.730120 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-862d23ee-74a8-40fd-82e0-62b95a0deb53 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:29.730587 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-862d23ee-74a8-40fd-82e0-62b95a0deb53 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:29.731018 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-862d23ee-74a8-40fd-82e0-62b95a0deb53 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:29.796848 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-6a6f52a6-5ac5-48f7-af63-cf6f4a729693 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:29.797556 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-6a6f52a6-5ac5-48f7-af63-cf6f4a729693 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: f634aa6d-e24c-48df-946f-3166fd76273a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:29.803816 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6a6f52a6-5ac5-48f7-af63-cf6f4a729693 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:29.804300 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6a6f52a6-5ac5-48f7-af63-cf6f4a729693 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:29.804763 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6a6f52a6-5ac5-48f7-af63-cf6f4a729693 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:29.805456 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6a6f52a6-5ac5-48f7-af63-cf6f4a729693 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:29.805953 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6a6f52a6-5ac5-48f7-af63-cf6f4a729693 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:29.806376 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6a6f52a6-5ac5-48f7-af63-cf6f4a729693 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:29.949415 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-6a6f52a6-5ac5-48f7-af63-cf6f4a729693 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:29.953001 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:56:29.959466 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-6a6f52a6-5ac5-48f7-af63-cf6f4a729693 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a" status: 200 len: 1522 microversion: 2.1 time: 0.166709 Sep 16 09:56:29.960048 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 409/814] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:29 2022] GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:56:30.150830 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-862d23ee-74a8-40fd-82e0-62b95a0deb53 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:30.158903 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-862d23ee-74a8-40fd-82e0-62b95a0deb53 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:30.161116 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-862d23ee-74a8-40fd-82e0-62b95a0deb53 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:30.162304 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-862d23ee-74a8-40fd-82e0-62b95a0deb53 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1723 microversion: 2.20 time: 0.446126 Sep 16 09:56:30.162883 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 406/815] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:56:29 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1723 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:56:30.386524 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-eead04c6-a2a0-4af3-9692-be4f4f096c3c tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:56:30.388839 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-eead04c6-a2a0-4af3-9692-be4f4f096c3c tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:30.396367 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-eead04c6-a2a0-4af3-9692-be4f4f096c3c tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:30.396843 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-eead04c6-a2a0-4af3-9692-be4f4f096c3c tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:30.397279 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-eead04c6-a2a0-4af3-9692-be4f4f096c3c tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:30.398050 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-eead04c6-a2a0-4af3-9692-be4f4f096c3c tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:30.398453 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-eead04c6-a2a0-4af3-9692-be4f4f096c3c tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:30.398877 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-eead04c6-a2a0-4af3-9692-be4f4f096c3c tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:30.613849 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-eead04c6-a2a0-4af3-9692-be4f4f096c3c tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "POST /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a/action" status: 202 len: 0 microversion: 2.1 time: 0.231185 Sep 16 09:56:30.614672 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 410/816] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Sep 16 09:56:30 2022] POST /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 09:56:30.622713 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-541650ad-6c6b-4853-a6e8-e7db7d1ed553 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:30.623236 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-541650ad-6c6b-4853-a6e8-e7db7d1ed553 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:30.629850 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-541650ad-6c6b-4853-a6e8-e7db7d1ed553 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:30.630341 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-541650ad-6c6b-4853-a6e8-e7db7d1ed553 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:30.630771 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-541650ad-6c6b-4853-a6e8-e7db7d1ed553 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:30.631464 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-541650ad-6c6b-4853-a6e8-e7db7d1ed553 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:30.631918 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-541650ad-6c6b-4853-a6e8-e7db7d1ed553 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:30.632351 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-541650ad-6c6b-4853-a6e8-e7db7d1ed553 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:30.649595 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-47b8b7cd-7552-48a2-933e-1f810d9d316b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:30.650271 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-47b8b7cd-7552-48a2-933e-1f810d9d316b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 2842e80e-fd61-48cf-b415-c5513f6811df] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:30.656353 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-47b8b7cd-7552-48a2-933e-1f810d9d316b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:30.656966 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-47b8b7cd-7552-48a2-933e-1f810d9d316b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:30.657286 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-47b8b7cd-7552-48a2-933e-1f810d9d316b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:30.658199 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-47b8b7cd-7552-48a2-933e-1f810d9d316b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:30.658658 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-47b8b7cd-7552-48a2-933e-1f810d9d316b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:30.659856 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-47b8b7cd-7552-48a2-933e-1f810d9d316b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:30.823055 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-47b8b7cd-7552-48a2-933e-1f810d9d316b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:30.832660 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-47b8b7cd-7552-48a2-933e-1f810d9d316b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df" status: 200 len: 1366 microversion: 2.1 time: 0.187335 Sep 16 09:56:30.841573 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 411/817] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:30 2022] GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:56:30.841573 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [req-76f7dea4-9ef1-4d24-b732-bb258fbb583b req-c9ecacdb-6bfd-4ac0-8881-dcc23868f98c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f634aa6d-e24c-48df-946f-3166fd76273a", "name": "network-vif-deleted", "tag": "2959b5a1-1a1a-4ce9-93ab-cb413d960925"}]} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:56:30.847813 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-76f7dea4-9ef1-4d24-b732-bb258fbb583b req-c9ecacdb-6bfd-4ac0-8881-dcc23868f98c service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:30.848525 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-76f7dea4-9ef1-4d24-b732-bb258fbb583b req-c9ecacdb-6bfd-4ac0-8881-dcc23868f98c service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:30.849141 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-76f7dea4-9ef1-4d24-b732-bb258fbb583b req-c9ecacdb-6bfd-4ac0-8881-dcc23868f98c service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:30.861876 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.compute.server_external_events [req-76f7dea4-9ef1-4d24-b732-bb258fbb583b req-c9ecacdb-6bfd-4ac0-8881-dcc23868f98c service nova] Creating event network-vif-deleted:2959b5a1-1a1a-4ce9-93ab-cb413d960925 for instance f634aa6d-e24c-48df-946f-3166fd76273a on hv-cinder-79053 Sep 16 09:56:30.867433 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [req-76f7dea4-9ef1-4d24-b732-bb258fbb583b req-c9ecacdb-6bfd-4ac0-8881-dcc23868f98c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032429 Sep 16 09:56:30.868398 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 412/818] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:56:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:56:30.922290 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-541650ad-6c6b-4853-a6e8-e7db7d1ed553 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b850cd7b216d4aab865886d20194f322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ebe25211ee4dcb887de8e0c9a03040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:30.931280 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-541650ad-6c6b-4853-a6e8-e7db7d1ed553 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a" status: 200 len: 1750 microversion: 2.1 time: 0.312359 Sep 16 09:56:30.931925 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 407/819] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:30 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a => generated 1750 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:56:30.982991 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-98079f75-040e-4daf-870c-922529840499 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:30.983688 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-98079f75-040e-4daf-870c-922529840499 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: f634aa6d-e24c-48df-946f-3166fd76273a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:30.992693 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-98079f75-040e-4daf-870c-922529840499 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:30.992693 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-98079f75-040e-4daf-870c-922529840499 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:30.992693 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-98079f75-040e-4daf-870c-922529840499 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:30.992693 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-98079f75-040e-4daf-870c-922529840499 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:30.993086 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-98079f75-040e-4daf-870c-922529840499 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:30.993086 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-98079f75-040e-4daf-870c-922529840499 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:31.060108 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-98079f75-040e-4daf-870c-922529840499 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1ce0bdadbc48d2899c7cdded5acb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0d52d42324aa38182b47b3588b979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:31.068897 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-98079f75-040e-4daf-870c-922529840499 tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a" status: 200 len: 1307 microversion: 2.1 time: 0.090432 Sep 16 09:56:31.069469 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 413/820] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:30 2022] GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a => generated 1307 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:56:31.188032 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-a68d4e80-350e-4144-b936-02427d5f0dbb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:31.188641 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-a68d4e80-350e-4144-b936-02427d5f0dbb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:31.195508 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a68d4e80-350e-4144-b936-02427d5f0dbb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:31.196385 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a68d4e80-350e-4144-b936-02427d5f0dbb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:31.196922 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a68d4e80-350e-4144-b936-02427d5f0dbb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:31.197572 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a68d4e80-350e-4144-b936-02427d5f0dbb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:31.198042 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a68d4e80-350e-4144-b936-02427d5f0dbb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:31.201439 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a68d4e80-350e-4144-b936-02427d5f0dbb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:31.439543 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-a68d4e80-350e-4144-b936-02427d5f0dbb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:31.454106 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-a68d4e80-350e-4144-b936-02427d5f0dbb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:31.455654 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-a68d4e80-350e-4144-b936-02427d5f0dbb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:31.456919 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-a68d4e80-350e-4144-b936-02427d5f0dbb tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1723 microversion: 2.20 time: 0.272988 Sep 16 09:56:31.462826 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 408/821] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:56:31 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1723 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:56:31.858605 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-ffae5969-33c0-451d-a42e-2890e2a96d8d tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:31.859127 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-e712e798-b4b6-4613-b6b8-08c4c9c381c5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:31.859509 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-ffae5969-33c0-451d-a42e-2890e2a96d8d tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] [instance: 8d0bc242-3744-4992-b1e3-819d84c53e50] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:31.859650 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-e712e798-b4b6-4613-b6b8-08c4c9c381c5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 2842e80e-fd61-48cf-b415-c5513f6811df] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:31.865813 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ffae5969-33c0-451d-a42e-2890e2a96d8d tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:31.866189 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e712e798-b4b6-4613-b6b8-08c4c9c381c5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:31.866327 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ffae5969-33c0-451d-a42e-2890e2a96d8d tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:31.866683 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e712e798-b4b6-4613-b6b8-08c4c9c381c5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:31.866809 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ffae5969-33c0-451d-a42e-2890e2a96d8d tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:31.867126 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e712e798-b4b6-4613-b6b8-08c4c9c381c5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:31.867391 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ffae5969-33c0-451d-a42e-2890e2a96d8d tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:31.867833 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e712e798-b4b6-4613-b6b8-08c4c9c381c5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:31.868003 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ffae5969-33c0-451d-a42e-2890e2a96d8d tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:31.868262 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ffae5969-33c0-451d-a42e-2890e2a96d8d tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:31.868381 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e712e798-b4b6-4613-b6b8-08c4c9c381c5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:31.868708 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e712e798-b4b6-4613-b6b8-08c4c9c381c5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:31.884382 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=100 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:56:31.894745 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-ffae5969-33c0-451d-a42e-2890e2a96d8d tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] [instance: 8d0bc242-3744-4992-b1e3-819d84c53e50] Going to try to terminate instance {{(pid=127671) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 09:56:32.007477 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-e712e798-b4b6-4613-b6b8-08c4c9c381c5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:32.015295 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-e712e798-b4b6-4613-b6b8-08c4c9c381c5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df" status: 200 len: 1366 microversion: 2.1 time: 0.160279 Sep 16 09:56:32.015872 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 409/822] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:31 2022] GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:56:32.020640 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-8a3280ad-32bc-4917-8bb2-ab5887849b13 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:32.021250 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-8a3280ad-32bc-4917-8bb2-ab5887849b13 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:32.026921 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8a3280ad-32bc-4917-8bb2-ab5887849b13 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:32.027416 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8a3280ad-32bc-4917-8bb2-ab5887849b13 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:32.027856 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8a3280ad-32bc-4917-8bb2-ab5887849b13 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:32.028555 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8a3280ad-32bc-4917-8bb2-ab5887849b13 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:32.029014 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8a3280ad-32bc-4917-8bb2-ab5887849b13 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:32.029440 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8a3280ad-32bc-4917-8bb2-ab5887849b13 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:32.179845 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-8a3280ad-32bc-4917-8bb2-ab5887849b13 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b850cd7b216d4aab865886d20194f322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ebe25211ee4dcb887de8e0c9a03040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:32.188208 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-8a3280ad-32bc-4917-8bb2-ab5887849b13 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a" status: 200 len: 1755 microversion: 2.1 time: 0.171325 Sep 16 09:56:32.188773 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 410/823] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:32 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:56:32.193827 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-1b8661c2-759b-4aaf-9c7b-e11e61d772ad tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:32.194441 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-1b8661c2-759b-4aaf-9c7b-e11e61d772ad tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] [instance: f634aa6d-e24c-48df-946f-3166fd76273a] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:32.200088 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1b8661c2-759b-4aaf-9c7b-e11e61d772ad tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:32.202126 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1b8661c2-759b-4aaf-9c7b-e11e61d772ad tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:32.202126 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1b8661c2-759b-4aaf-9c7b-e11e61d772ad tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:32.202126 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1b8661c2-759b-4aaf-9c7b-e11e61d772ad tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:32.202424 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1b8661c2-759b-4aaf-9c7b-e11e61d772ad tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:32.202924 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1b8661c2-759b-4aaf-9c7b-e11e61d772ad tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:32.218540 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.wsgi [None req-1b8661c2-759b-4aaf-9c7b-e11e61d772ad tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] HTTP exception thrown: Instance f634aa6d-e24c-48df-946f-3166fd76273a could not be found. Sep 16 09:56:32.220176 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-1b8661c2-759b-4aaf-9c7b-e11e61d772ad tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Request method failure captured: Sep 16 09:56:32.220176 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: request: GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a HTTP/1.1 Sep 16 09:56:32.220176 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept: application/json Sep 16 09:56:32.220176 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Sep 16 09:56:32.220176 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Connection: close Sep 16 09:56:32.220176 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Length: 0 Sep 16 09:56:32.220176 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Type: application/json Sep 16 09:56:32.220176 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Host: 10.222.0.73 Sep 16 09:56:32.220176 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Sep 16 09:56:32.220176 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Sep 16 09:56:32.220176 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjJEbxR-3pAhLiwb3ckUO6s_con7PzqaMH7LIfbFMfWWksbJi1GgWKz99k_xTyog5rd5nWR-OSR9_6_XhX2Wo2YD5uM25GUSMoNymOY18MnkEv9j1oga2G7G47Yhfh-dJVj2X4Cf2GB-s6CbFgJzG7jcNz64ctztxMfjiQALnI2E37Lf0 Sep 16 09:56:32.220176 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Sep 16 09:56:32.220176 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Sep 16 09:56:32.220176 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Sep 16 09:56:32.220176 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Sep 16 09:56:32.220176 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Sep 16 09:56:32.220176 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Sep 16 09:56:32.220176 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Id: 3fe0d52d42324aa38182b47b3588b979 Sep 16 09:56:32.220176 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1278542283 Sep 16 09:56:32.220176 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Role: reader,member Sep 16 09:56:32.220176 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Roles: reader,member Sep 16 09:56:32.226736 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/3fe0d52d42324aa38182b47b3588b979"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_3fe0d52d42324aa38182b47b3588b979", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/3fe0d52d42324aa38182b47b3588b979"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/3fe0d52d42324aa38182b47b3588b979"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 09:56:32.226736 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1278542283 Sep 16 09:56:32.226736 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Id: 3fe0d52d42324aa38182b47b3588b979 Sep 16 09:56:32.226736 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1278542283 Sep 16 09:56:32.226736 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User: tempest-ServerRescueNegativeTestJSON-1278542283-project Sep 16 09:56:32.226736 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Sep 16 09:56:32.226736 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Sep 16 09:56:32.226736 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Id: 8d1ce0bdadbc48d2899c7cdded5acb5c Sep 16 09:56:32.226736 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1278542283-project Sep 16 09:56:32.226736 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: method: > Sep 16 09:56:32.226736 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: exception: Instance f634aa6d-e24c-48df-946f-3166fd76273a could not be found. Sep 16 09:56:32.226736 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: action_args: {'id': 'f634aa6d-e24c-48df-946f-3166fd76273a'} Sep 16 09:56:32.227631 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 09:56:32.227631 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:56:32.227631 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 09:56:32.227631 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 09:56:32.227631 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 09:56:32.227631 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 09:56:32.227631 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 09:56:32.227631 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 09:56:32.227631 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 09:56:32.227631 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 09:56:32.227631 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f634aa6d-e24c-48df-946f-3166fd76273a could not be found. Sep 16 09:56:32.227631 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:56:32.227631 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:56:32.227631 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:56:32.227631 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:56:32.227631 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:56:32.227631 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:56:32.227631 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 09:56:32.227631 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 09:56:32.227631 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 09:56:32.229489 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:56:32.229489 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 09:56:32.229489 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 09:56:32.229489 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 09:56:32.229489 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 09:56:32.229489 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 09:56:32.229489 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 09:56:32.229489 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f634aa6d-e24c-48df-946f-3166fd76273a could not be found. Sep 16 09:56:32.229489 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:56:32.229489 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:56:32.229489 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:56:32.229489 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:56:32.229489 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:56:32.229489 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:56:32.229489 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 09:56:32.229489 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 09:56:32.229489 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f634aa6d-e24c-48df-946f-3166fd76273a could not be found. Sep 16 09:56:32.229489 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:56:32.231032 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-1b8661c2-759b-4aaf-9c7b-e11e61d772ad tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] Returning 404 to user: Instance f634aa6d-e24c-48df-946f-3166fd76273a could not be found. {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 09:56:32.231032 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-1b8661c2-759b-4aaf-9c7b-e11e61d772ad tempest-ServerRescueNegativeTestJSON-1278542283 tempest-ServerRescueNegativeTestJSON-1278542283-project] 10.222.0.73 "GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a" status: 404 len: 111 microversion: 2.1 time: 0.033701 Sep 16 09:56:32.231032 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 411/824] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:32 2022] GET /compute/v2.1/servers/f634aa6d-e24c-48df-946f-3166fd76273a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 09:56:32.244586 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-ffae5969-33c0-451d-a42e-2890e2a96d8d tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] 10.222.0.73 "DELETE /compute/v2.1/servers/8d0bc242-3744-4992-b1e3-819d84c53e50" status: 204 len: 0 microversion: 2.1 time: 0.389597 Sep 16 09:56:32.245259 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 414/825] 10.222.0.73 () {58 vars in 1239 bytes} [Fri Sep 16 09:56:31 2022] DELETE /compute/v2.1/servers/8d0bc242-3744-4992-b1e3-819d84c53e50 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 09:56:32.257092 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-cf0df6cb-8d3a-4aae-925c-fa15bacca2d0 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:32.257788 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-cf0df6cb-8d3a-4aae-925c-fa15bacca2d0 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] [instance: 8d0bc242-3744-4992-b1e3-819d84c53e50] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:32.263639 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cf0df6cb-8d3a-4aae-925c-fa15bacca2d0 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:32.264122 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cf0df6cb-8d3a-4aae-925c-fa15bacca2d0 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:32.264561 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cf0df6cb-8d3a-4aae-925c-fa15bacca2d0 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:32.265246 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cf0df6cb-8d3a-4aae-925c-fa15bacca2d0 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:32.265726 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cf0df6cb-8d3a-4aae-925c-fa15bacca2d0 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:32.266152 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-cf0df6cb-8d3a-4aae-925c-fa15bacca2d0 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:32.482431 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-cf0df6cb-8d3a-4aae-925c-fa15bacca2d0 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1142f8595de54bfc8f28a5152eaa00d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d2a4f111114064aa5a477177e6d1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:32.488142 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-785489f5-93ee-4cf4-891c-734c2b32652e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:32.488862 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-785489f5-93ee-4cf4-891c-734c2b32652e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:32.490829 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-cf0df6cb-8d3a-4aae-925c-fa15bacca2d0 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] 10.222.0.73 "GET /compute/v2.1/servers/8d0bc242-3744-4992-b1e3-819d84c53e50" status: 200 len: 1511 microversion: 2.1 time: 0.238091 Sep 16 09:56:32.505569 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 412/826] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:32 2022] GET /compute/v2.1/servers/8d0bc242-3744-4992-b1e3-819d84c53e50 => generated 1511 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:56:32.505847 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-785489f5-93ee-4cf4-891c-734c2b32652e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:32.505847 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-785489f5-93ee-4cf4-891c-734c2b32652e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:32.505847 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-785489f5-93ee-4cf4-891c-734c2b32652e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:32.505847 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-785489f5-93ee-4cf4-891c-734c2b32652e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:32.506246 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-785489f5-93ee-4cf4-891c-734c2b32652e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:32.506246 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-785489f5-93ee-4cf4-891c-734c2b32652e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:32.629279 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-785489f5-93ee-4cf4-891c-734c2b32652e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:32.637352 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-785489f5-93ee-4cf4-891c-734c2b32652e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:32.638849 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-785489f5-93ee-4cf4-891c-734c2b32652e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:32.640056 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-785489f5-93ee-4cf4-891c-734c2b32652e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1723 microversion: 2.20 time: 0.156770 Sep 16 09:56:32.640624 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 415/827] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:56:32 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:56:33.038718 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-1e24d4f6-6755-4adf-ba23-326e0b86fbf8 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:33.039434 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-1e24d4f6-6755-4adf-ba23-326e0b86fbf8 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 2842e80e-fd61-48cf-b415-c5513f6811df] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:33.045945 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1e24d4f6-6755-4adf-ba23-326e0b86fbf8 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:33.046521 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1e24d4f6-6755-4adf-ba23-326e0b86fbf8 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:33.047040 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1e24d4f6-6755-4adf-ba23-326e0b86fbf8 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:33.047821 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1e24d4f6-6755-4adf-ba23-326e0b86fbf8 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:33.048358 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1e24d4f6-6755-4adf-ba23-326e0b86fbf8 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:33.048862 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1e24d4f6-6755-4adf-ba23-326e0b86fbf8 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:33.211885 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-e2070106-31c4-4232-a710-dbccdca07fc0 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:33.212489 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-e2070106-31c4-4232-a710-dbccdca07fc0 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:33.220358 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e2070106-31c4-4232-a710-dbccdca07fc0 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:33.221077 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e2070106-31c4-4232-a710-dbccdca07fc0 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:33.222254 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e2070106-31c4-4232-a710-dbccdca07fc0 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:33.222964 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e2070106-31c4-4232-a710-dbccdca07fc0 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:33.223415 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e2070106-31c4-4232-a710-dbccdca07fc0 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:33.223838 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e2070106-31c4-4232-a710-dbccdca07fc0 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:33.250529 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-1e24d4f6-6755-4adf-ba23-326e0b86fbf8 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:33.277377 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-1e24d4f6-6755-4adf-ba23-326e0b86fbf8 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df" status: 200 len: 1366 microversion: 2.1 time: 0.243098 Sep 16 09:56:33.278461 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 413/828] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:33 2022] GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df => generated 1366 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:56:33.388791 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-e2070106-31c4-4232-a710-dbccdca07fc0 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b850cd7b216d4aab865886d20194f322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ebe25211ee4dcb887de8e0c9a03040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:33.398753 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-e2070106-31c4-4232-a710-dbccdca07fc0 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a" status: 200 len: 1755 microversion: 2.1 time: 0.190900 Sep 16 09:56:33.399450 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 416/829] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:33 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a => generated 1755 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:56:33.515371 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-6412f0d1-8c16-4522-aed2-ddc26d363578 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:33.515997 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-6412f0d1-8c16-4522-aed2-ddc26d363578 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] [instance: 8d0bc242-3744-4992-b1e3-819d84c53e50] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:33.522958 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6412f0d1-8c16-4522-aed2-ddc26d363578 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:33.523343 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6412f0d1-8c16-4522-aed2-ddc26d363578 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:33.523782 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6412f0d1-8c16-4522-aed2-ddc26d363578 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:33.524656 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6412f0d1-8c16-4522-aed2-ddc26d363578 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:33.525119 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6412f0d1-8c16-4522-aed2-ddc26d363578 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:33.525581 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6412f0d1-8c16-4522-aed2-ddc26d363578 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:33.666583 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-a7acfe18-f135-4902-b18f-f18ef62dc02d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:33.667225 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-a7acfe18-f135-4902-b18f-f18ef62dc02d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:33.673224 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a7acfe18-f135-4902-b18f-f18ef62dc02d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:33.673760 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a7acfe18-f135-4902-b18f-f18ef62dc02d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:33.674203 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a7acfe18-f135-4902-b18f-f18ef62dc02d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:33.675512 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a7acfe18-f135-4902-b18f-f18ef62dc02d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:33.675986 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a7acfe18-f135-4902-b18f-f18ef62dc02d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:33.676425 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a7acfe18-f135-4902-b18f-f18ef62dc02d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:33.747151 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-6412f0d1-8c16-4522-aed2-ddc26d363578 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1142f8595de54bfc8f28a5152eaa00d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d2a4f111114064aa5a477177e6d1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:33.756375 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-6412f0d1-8c16-4522-aed2-ddc26d363578 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] 10.222.0.73 "GET /compute/v2.1/servers/8d0bc242-3744-4992-b1e3-819d84c53e50" status: 200 len: 1511 microversion: 2.1 time: 0.244575 Sep 16 09:56:33.757556 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 414/830] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:33 2022] GET /compute/v2.1/servers/8d0bc242-3744-4992-b1e3-819d84c53e50 => generated 1511 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:56:33.814747 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-a7acfe18-f135-4902-b18f-f18ef62dc02d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:33.823720 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-a7acfe18-f135-4902-b18f-f18ef62dc02d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:33.825226 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-a7acfe18-f135-4902-b18f-f18ef62dc02d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:33.826452 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-a7acfe18-f135-4902-b18f-f18ef62dc02d tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1723 microversion: 2.20 time: 0.163884 Sep 16 09:56:33.827008 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 417/831] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:56:33 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 09:56:34.301224 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-bc7d8521-79ff-402c-b71d-d3ff15a8eaf5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:34.302570 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-bc7d8521-79ff-402c-b71d-d3ff15a8eaf5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 2842e80e-fd61-48cf-b415-c5513f6811df] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:34.309448 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bc7d8521-79ff-402c-b71d-d3ff15a8eaf5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:34.310281 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bc7d8521-79ff-402c-b71d-d3ff15a8eaf5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:34.310953 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bc7d8521-79ff-402c-b71d-d3ff15a8eaf5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:34.311896 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bc7d8521-79ff-402c-b71d-d3ff15a8eaf5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:34.312576 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bc7d8521-79ff-402c-b71d-d3ff15a8eaf5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:34.313222 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bc7d8521-79ff-402c-b71d-d3ff15a8eaf5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:34.430585 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-8e34f714-8597-4f05-8fc8-a3c5c03f2359 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:34.431911 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-8e34f714-8597-4f05-8fc8-a3c5c03f2359 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:34.441672 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8e34f714-8597-4f05-8fc8-a3c5c03f2359 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:34.442828 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8e34f714-8597-4f05-8fc8-a3c5c03f2359 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:34.443752 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8e34f714-8597-4f05-8fc8-a3c5c03f2359 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:34.445877 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8e34f714-8597-4f05-8fc8-a3c5c03f2359 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:34.451874 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8e34f714-8597-4f05-8fc8-a3c5c03f2359 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:34.452742 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8e34f714-8597-4f05-8fc8-a3c5c03f2359 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:34.512378 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-bc7d8521-79ff-402c-b71d-d3ff15a8eaf5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:34.521395 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-bc7d8521-79ff-402c-b71d-d3ff15a8eaf5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df" status: 200 len: 1366 microversion: 2.1 time: 0.224861 Sep 16 09:56:34.527282 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 415/832] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:34 2022] GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:56:34.639702 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-d6ee72ac-8f0d-492b-863d-d1d2571187bd req-f52ba208-d333-4289-8445-bc58b0c3e9ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d0bc242-3744-4992-b1e3-819d84c53e50", "name": "network-vif-deleted", "tag": "fe584d9e-61d6-4f6d-bd29-09afbf94e2fe"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:56:34.662228 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-d6ee72ac-8f0d-492b-863d-d1d2571187bd req-f52ba208-d333-4289-8445-bc58b0c3e9ff service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:34.667308 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-d6ee72ac-8f0d-492b-863d-d1d2571187bd req-f52ba208-d333-4289-8445-bc58b0c3e9ff service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:34.667308 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-d6ee72ac-8f0d-492b-863d-d1d2571187bd req-f52ba208-d333-4289-8445-bc58b0c3e9ff service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:34.674365 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-d6ee72ac-8f0d-492b-863d-d1d2571187bd req-f52ba208-d333-4289-8445-bc58b0c3e9ff service nova] Creating event network-vif-deleted:fe584d9e-61d6-4f6d-bd29-09afbf94e2fe for instance 8d0bc242-3744-4992-b1e3-819d84c53e50 on hv-cinder-79053 Sep 16 09:56:34.680432 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-d6ee72ac-8f0d-492b-863d-d1d2571187bd req-f52ba208-d333-4289-8445-bc58b0c3e9ff service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044971 Sep 16 09:56:34.681048 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 416/833] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 09:56:34.763119 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-8e34f714-8597-4f05-8fc8-a3c5c03f2359 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b850cd7b216d4aab865886d20194f322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ebe25211ee4dcb887de8e0c9a03040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:34.772077 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-8e34f714-8597-4f05-8fc8-a3c5c03f2359 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a" status: 200 len: 1755 microversion: 2.1 time: 0.351290 Sep 16 09:56:34.772669 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 418/834] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:34 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a => generated 1755 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:56:34.780668 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-f286f72a-b53e-4b9b-b4eb-42f2bd106351 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:34.781432 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-f286f72a-b53e-4b9b-b4eb-42f2bd106351 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] [instance: 8d0bc242-3744-4992-b1e3-819d84c53e50] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:34.788537 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f286f72a-b53e-4b9b-b4eb-42f2bd106351 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:34.789027 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f286f72a-b53e-4b9b-b4eb-42f2bd106351 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:34.789467 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f286f72a-b53e-4b9b-b4eb-42f2bd106351 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:34.790193 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f286f72a-b53e-4b9b-b4eb-42f2bd106351 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:34.790654 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f286f72a-b53e-4b9b-b4eb-42f2bd106351 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:34.791080 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f286f72a-b53e-4b9b-b4eb-42f2bd106351 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:34.853519 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-60cbc8e2-6076-4f48-a5ba-952d8dda145f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:34.854409 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-60cbc8e2-6076-4f48-a5ba-952d8dda145f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:34.862814 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-60cbc8e2-6076-4f48-a5ba-952d8dda145f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:34.862814 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-60cbc8e2-6076-4f48-a5ba-952d8dda145f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:34.862814 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-60cbc8e2-6076-4f48-a5ba-952d8dda145f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:34.863204 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-60cbc8e2-6076-4f48-a5ba-952d8dda145f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:34.863858 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-60cbc8e2-6076-4f48-a5ba-952d8dda145f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:34.864127 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f286f72a-b53e-4b9b-b4eb-42f2bd106351 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1142f8595de54bfc8f28a5152eaa00d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d2a4f111114064aa5a477177e6d1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:34.864291 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-60cbc8e2-6076-4f48-a5ba-952d8dda145f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:34.872756 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-f286f72a-b53e-4b9b-b4eb-42f2bd106351 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] 10.222.0.73 "GET /compute/v2.1/servers/8d0bc242-3744-4992-b1e3-819d84c53e50" status: 200 len: 1469 microversion: 2.1 time: 0.096411 Sep 16 09:56:34.877636 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 417/835] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:34 2022] GET /compute/v2.1/servers/8d0bc242-3744-4992-b1e3-819d84c53e50 => generated 1469 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:56:35.165579 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-ddc4c2c6-1a1e-4b68-8c66-b1099c6e0864 req-06a91125-f0b0-4f7a-b80d-b9933b3892df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2842e80e-fd61-48cf-b415-c5513f6811df", "name": "network-vif-plugged", "status": "completed", "tag": "d77fbe69-b931-4dfb-ac17-d581d7f6781e"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:56:35.169888 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-60cbc8e2-6076-4f48-a5ba-952d8dda145f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:35.177663 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-ddc4c2c6-1a1e-4b68-8c66-b1099c6e0864 req-06a91125-f0b0-4f7a-b80d-b9933b3892df service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:35.178431 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-ddc4c2c6-1a1e-4b68-8c66-b1099c6e0864 req-06a91125-f0b0-4f7a-b80d-b9933b3892df service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:35.179408 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-ddc4c2c6-1a1e-4b68-8c66-b1099c6e0864 req-06a91125-f0b0-4f7a-b80d-b9933b3892df service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:35.182747 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-60cbc8e2-6076-4f48-a5ba-952d8dda145f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:35.188085 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-60cbc8e2-6076-4f48-a5ba-952d8dda145f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:35.189843 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-60cbc8e2-6076-4f48-a5ba-952d8dda145f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1723 microversion: 2.20 time: 0.340268 Sep 16 09:56:35.191172 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 419/836] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:56:34 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1723 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 09:56:35.195203 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-ddc4c2c6-1a1e-4b68-8c66-b1099c6e0864 req-06a91125-f0b0-4f7a-b80d-b9933b3892df service nova] Creating event network-vif-plugged:d77fbe69-b931-4dfb-ac17-d581d7f6781e for instance 2842e80e-fd61-48cf-b415-c5513f6811df on hv-cinder-79053 Sep 16 09:56:35.201990 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-ddc4c2c6-1a1e-4b68-8c66-b1099c6e0864 req-06a91125-f0b0-4f7a-b80d-b9933b3892df service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170031 Sep 16 09:56:35.203339 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 418/837] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:56:35.550433 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-29edefbe-d6cb-4e90-9800-057268ab48ab tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:35.551165 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-29edefbe-d6cb-4e90-9800-057268ab48ab tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 2842e80e-fd61-48cf-b415-c5513f6811df] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:35.559148 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-29edefbe-d6cb-4e90-9800-057268ab48ab tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:35.559916 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-29edefbe-d6cb-4e90-9800-057268ab48ab tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:35.561247 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-29edefbe-d6cb-4e90-9800-057268ab48ab tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:35.562289 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-29edefbe-d6cb-4e90-9800-057268ab48ab tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:35.563337 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-29edefbe-d6cb-4e90-9800-057268ab48ab tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:35.563835 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-29edefbe-d6cb-4e90-9800-057268ab48ab tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:35.737945 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-29edefbe-d6cb-4e90-9800-057268ab48ab tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:35.745940 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-29edefbe-d6cb-4e90-9800-057268ab48ab tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df" status: 200 len: 1366 microversion: 2.1 time: 0.199332 Sep 16 09:56:35.758613 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 420/838] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:35 2022] GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:56:35.797275 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-25452d68-2922-46ae-8a7d-a3f02c01e457 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:35.798635 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-25452d68-2922-46ae-8a7d-a3f02c01e457 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:35.809633 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-25452d68-2922-46ae-8a7d-a3f02c01e457 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:35.810338 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-25452d68-2922-46ae-8a7d-a3f02c01e457 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:35.810965 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-25452d68-2922-46ae-8a7d-a3f02c01e457 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:35.811876 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-25452d68-2922-46ae-8a7d-a3f02c01e457 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:35.812768 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-25452d68-2922-46ae-8a7d-a3f02c01e457 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:35.813405 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-25452d68-2922-46ae-8a7d-a3f02c01e457 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:35.897434 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-7081b72b-318e-4d4a-ba6b-b2986b30c16b tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:35.898142 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-7081b72b-318e-4d4a-ba6b-b2986b30c16b tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] [instance: 8d0bc242-3744-4992-b1e3-819d84c53e50] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:35.904312 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7081b72b-318e-4d4a-ba6b-b2986b30c16b tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:35.904810 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7081b72b-318e-4d4a-ba6b-b2986b30c16b tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:35.905254 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7081b72b-318e-4d4a-ba6b-b2986b30c16b tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:35.905998 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7081b72b-318e-4d4a-ba6b-b2986b30c16b tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:35.906458 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7081b72b-318e-4d4a-ba6b-b2986b30c16b tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:35.906890 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7081b72b-318e-4d4a-ba6b-b2986b30c16b tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:35.943418 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7081b72b-318e-4d4a-ba6b-b2986b30c16b tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:35.943937 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7081b72b-318e-4d4a-ba6b-b2986b30c16b tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:35.944456 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7081b72b-318e-4d4a-ba6b-b2986b30c16b tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:35.944910 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.objects.instance [None req-7081b72b-318e-4d4a-ba6b-b2986b30c16b tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lazy-loading 'fault' on Instance uuid 8d0bc242-3744-4992-b1e3-819d84c53e50 {{(pid=127671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 09:56:35.998749 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-7081b72b-318e-4d4a-ba6b-b2986b30c16b tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1142f8595de54bfc8f28a5152eaa00d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d2a4f111114064aa5a477177e6d1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:36.008884 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-7081b72b-318e-4d4a-ba6b-b2986b30c16b tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] 10.222.0.73 "GET /compute/v2.1/servers/8d0bc242-3744-4992-b1e3-819d84c53e50" status: 200 len: 1307 microversion: 2.1 time: 0.116119 Sep 16 09:56:36.014509 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 421/839] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:35 2022] GET /compute/v2.1/servers/8d0bc242-3744-4992-b1e3-819d84c53e50 => generated 1307 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:56:36.078828 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-25452d68-2922-46ae-8a7d-a3f02c01e457 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b850cd7b216d4aab865886d20194f322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ebe25211ee4dcb887de8e0c9a03040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:36.088796 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-25452d68-2922-46ae-8a7d-a3f02c01e457 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a" status: 200 len: 1755 microversion: 2.1 time: 0.296109 Sep 16 09:56:36.089892 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 419/840] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:35 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a => generated 1755 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:56:36.216074 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-d9842de6-f9bc-4061-8c04-e68601b8c002 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:36.216687 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-d9842de6-f9bc-4061-8c04-e68601b8c002 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:36.222891 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d9842de6-f9bc-4061-8c04-e68601b8c002 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:36.223384 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d9842de6-f9bc-4061-8c04-e68601b8c002 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:36.223830 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d9842de6-f9bc-4061-8c04-e68601b8c002 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:36.224536 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d9842de6-f9bc-4061-8c04-e68601b8c002 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:36.224999 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d9842de6-f9bc-4061-8c04-e68601b8c002 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:36.225434 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d9842de6-f9bc-4061-8c04-e68601b8c002 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:36.365659 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-d9842de6-f9bc-4061-8c04-e68601b8c002 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:36.374744 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-d9842de6-f9bc-4061-8c04-e68601b8c002 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:36.376311 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-d9842de6-f9bc-4061-8c04-e68601b8c002 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:36.378232 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-d9842de6-f9bc-4061-8c04-e68601b8c002 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1723 microversion: 2.20 time: 0.165756 Sep 16 09:56:36.378980 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 422/841] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:56:36 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:56:36.773963 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-5421f38e-8e2c-47a2-be12-a8ad2087b14b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:36.774579 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-5421f38e-8e2c-47a2-be12-a8ad2087b14b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 2842e80e-fd61-48cf-b415-c5513f6811df] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:36.780442 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5421f38e-8e2c-47a2-be12-a8ad2087b14b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:36.780924 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5421f38e-8e2c-47a2-be12-a8ad2087b14b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:36.781357 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5421f38e-8e2c-47a2-be12-a8ad2087b14b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:36.782073 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5421f38e-8e2c-47a2-be12-a8ad2087b14b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:36.782589 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5421f38e-8e2c-47a2-be12-a8ad2087b14b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:36.783014 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5421f38e-8e2c-47a2-be12-a8ad2087b14b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:36.930989 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-5421f38e-8e2c-47a2-be12-a8ad2087b14b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:36.938656 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-5421f38e-8e2c-47a2-be12-a8ad2087b14b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df" status: 200 len: 1366 microversion: 2.1 time: 0.168720 Sep 16 09:56:36.939213 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 420/842] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:36 2022] GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:56:37.032376 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-6b235d8d-55dc-4c54-b7a9-56cac623e865 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:37.033016 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-6b235d8d-55dc-4c54-b7a9-56cac623e865 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] [instance: 8d0bc242-3744-4992-b1e3-819d84c53e50] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:37.040275 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6b235d8d-55dc-4c54-b7a9-56cac623e865 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:37.040840 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6b235d8d-55dc-4c54-b7a9-56cac623e865 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:37.041380 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6b235d8d-55dc-4c54-b7a9-56cac623e865 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:37.042260 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6b235d8d-55dc-4c54-b7a9-56cac623e865 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:37.042828 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6b235d8d-55dc-4c54-b7a9-56cac623e865 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:37.043359 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6b235d8d-55dc-4c54-b7a9-56cac623e865 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:37.058772 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.wsgi [None req-6b235d8d-55dc-4c54-b7a9-56cac623e865 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] HTTP exception thrown: Instance 8d0bc242-3744-4992-b1e3-819d84c53e50 could not be found. Sep 16 09:56:37.060490 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-6b235d8d-55dc-4c54-b7a9-56cac623e865 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Request method failure captured: Sep 16 09:56:37.060490 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: request: GET /compute/v2.1/servers/8d0bc242-3744-4992-b1e3-819d84c53e50 HTTP/1.1 Sep 16 09:56:37.060490 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept: application/json Sep 16 09:56:37.060490 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept-Encoding: identity Sep 16 09:56:37.060490 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Connection: close Sep 16 09:56:37.060490 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Length: 0 Sep 16 09:56:37.060490 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Type: application/json Sep 16 09:56:37.060490 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Host: 10.222.0.73 Sep 16 09:56:37.060490 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Openstack-System-Scope: None Sep 16 09:56:37.060490 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: User-Agent: python-urllib3/1.26.12 Sep 16 09:56:37.060490 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Auth-Token: gAAAAABjJEfNpqKGXwy_iXG64w2PJ1Nx_Taqk-joxDcgOYE1IjGGYxs5meGacmOH-wKhPLyL1AGxm_zSIBjZnp_gJNf0IXhdQcL1V-6xQvwA39L_sjxA0QpLbBN_X2KeNJFk873ssN0PyD9kBoutoQtMDg4gwksmLwdi-4Cl4syEpK4eBz9DYso Sep 16 09:56:37.060490 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Id: None Sep 16 09:56:37.060490 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Name: None Sep 16 09:56:37.060490 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Identity-Status: Confirmed Sep 16 09:56:37.060490 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Is-Admin-Project: True Sep 16 09:56:37.060490 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Id: default Sep 16 09:56:37.060490 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Name: Default Sep 16 09:56:37.060490 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Id: 01d2a4f111114064aa5a477177e6d1dd Sep 16 09:56:37.060490 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1272653757 Sep 16 09:56:37.060490 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Role: reader,member Sep 16 09:56:37.060490 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Roles: reader,member Sep 16 09:56:37.062818 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/01d2a4f111114064aa5a477177e6d1dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_01d2a4f111114064aa5a477177e6d1dd", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/01d2a4f111114064aa5a477177e6d1dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/01d2a4f111114064aa5a477177e6d1dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 09:56:37.062818 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant: tempest-VolumesSnapshotTestJSON-1272653757 Sep 16 09:56:37.062818 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Id: 01d2a4f111114064aa5a477177e6d1dd Sep 16 09:56:37.062818 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1272653757 Sep 16 09:56:37.062818 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User: tempest-VolumesSnapshotTestJSON-1272653757-project Sep 16 09:56:37.062818 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Id: default Sep 16 09:56:37.062818 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Name: Default Sep 16 09:56:37.062818 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Id: 1142f8595de54bfc8f28a5152eaa00d1 Sep 16 09:56:37.062818 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Name: tempest-VolumesSnapshotTestJSON-1272653757-project Sep 16 09:56:37.062818 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: method: > Sep 16 09:56:37.062818 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: exception: Instance 8d0bc242-3744-4992-b1e3-819d84c53e50 could not be found. Sep 16 09:56:37.062818 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: action_args: {'id': '8d0bc242-3744-4992-b1e3-819d84c53e50'} Sep 16 09:56:37.064067 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 09:56:37.064067 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:56:37.064067 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 09:56:37.064067 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 09:56:37.064067 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 09:56:37.064067 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 09:56:37.064067 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 09:56:37.064067 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 09:56:37.064067 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 09:56:37.064067 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 09:56:37.064067 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d0bc242-3744-4992-b1e3-819d84c53e50 could not be found. Sep 16 09:56:37.064067 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:56:37.064067 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:56:37.064067 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:56:37.064067 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:56:37.064067 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:56:37.064067 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:56:37.064067 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 09:56:37.064067 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 09:56:37.064067 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 09:56:37.067291 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:56:37.067291 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 09:56:37.067291 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 09:56:37.067291 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 09:56:37.067291 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 09:56:37.067291 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 09:56:37.067291 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 09:56:37.067291 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d0bc242-3744-4992-b1e3-819d84c53e50 could not be found. Sep 16 09:56:37.067291 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:56:37.067291 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:56:37.067291 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:56:37.067291 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:56:37.067291 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:56:37.067291 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:56:37.067291 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 09:56:37.067291 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 09:56:37.067291 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d0bc242-3744-4992-b1e3-819d84c53e50 could not be found. Sep 16 09:56:37.067291 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:56:37.069578 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-6b235d8d-55dc-4c54-b7a9-56cac623e865 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] Returning 404 to user: Instance 8d0bc242-3744-4992-b1e3-819d84c53e50 could not be found. {{(pid=127671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 09:56:37.069578 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-6b235d8d-55dc-4c54-b7a9-56cac623e865 tempest-VolumesSnapshotTestJSON-1272653757 tempest-VolumesSnapshotTestJSON-1272653757-project] 10.222.0.73 "GET /compute/v2.1/servers/8d0bc242-3744-4992-b1e3-819d84c53e50" status: 404 len: 111 microversion: 2.1 time: 0.033679 Sep 16 09:56:37.069578 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 423/843] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:37 2022] GET /compute/v2.1/servers/8d0bc242-3744-4992-b1e3-819d84c53e50 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 09:56:37.112949 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-bbcacba0-a255-445f-94c9-3b8fc4e39ff2 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:37.114005 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-bbcacba0-a255-445f-94c9-3b8fc4e39ff2 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:37.121863 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bbcacba0-a255-445f-94c9-3b8fc4e39ff2 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:37.122600 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bbcacba0-a255-445f-94c9-3b8fc4e39ff2 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:37.123107 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bbcacba0-a255-445f-94c9-3b8fc4e39ff2 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:37.125721 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bbcacba0-a255-445f-94c9-3b8fc4e39ff2 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:37.126415 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bbcacba0-a255-445f-94c9-3b8fc4e39ff2 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:37.126917 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bbcacba0-a255-445f-94c9-3b8fc4e39ff2 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:37.293397 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-bbcacba0-a255-445f-94c9-3b8fc4e39ff2 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b850cd7b216d4aab865886d20194f322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ebe25211ee4dcb887de8e0c9a03040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:37.303779 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-bbcacba0-a255-445f-94c9-3b8fc4e39ff2 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a" status: 200 len: 1755 microversion: 2.1 time: 0.195447 Sep 16 09:56:37.304447 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 421/844] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:37 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a => generated 1755 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:56:37.405784 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-8a84479c-9a77-4f3d-8fbf-e21cfd4e9ecc tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:37.406521 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-8a84479c-9a77-4f3d-8fbf-e21cfd4e9ecc tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:37.413458 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8a84479c-9a77-4f3d-8fbf-e21cfd4e9ecc tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:37.414018 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8a84479c-9a77-4f3d-8fbf-e21cfd4e9ecc tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:37.414459 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8a84479c-9a77-4f3d-8fbf-e21cfd4e9ecc tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:37.415166 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8a84479c-9a77-4f3d-8fbf-e21cfd4e9ecc tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:37.415664 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8a84479c-9a77-4f3d-8fbf-e21cfd4e9ecc tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:37.416089 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8a84479c-9a77-4f3d-8fbf-e21cfd4e9ecc tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:37.569561 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-8a84479c-9a77-4f3d-8fbf-e21cfd4e9ecc tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:37.573414 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:56:37.578370 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-8a84479c-9a77-4f3d-8fbf-e21cfd4e9ecc tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:37.579851 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-8a84479c-9a77-4f3d-8fbf-e21cfd4e9ecc tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:37.581729 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-8a84479c-9a77-4f3d-8fbf-e21cfd4e9ecc tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1723 microversion: 2.20 time: 0.179893 Sep 16 09:56:37.582423 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 424/845] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:56:37 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:56:37.967460 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-bccc1a48-2ec8-4639-b4cf-7cc92e4258ec tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:37.968114 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-bccc1a48-2ec8-4639-b4cf-7cc92e4258ec tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 2842e80e-fd61-48cf-b415-c5513f6811df] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:37.970830 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:56:37.978266 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bccc1a48-2ec8-4639-b4cf-7cc92e4258ec tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:37.978266 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bccc1a48-2ec8-4639-b4cf-7cc92e4258ec tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:37.978266 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bccc1a48-2ec8-4639-b4cf-7cc92e4258ec tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:37.978545 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bccc1a48-2ec8-4639-b4cf-7cc92e4258ec tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:37.979223 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bccc1a48-2ec8-4639-b4cf-7cc92e4258ec tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:37.979788 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bccc1a48-2ec8-4639-b4cf-7cc92e4258ec tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:38.115541 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-bccc1a48-2ec8-4639-b4cf-7cc92e4258ec tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:38.123280 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-bccc1a48-2ec8-4639-b4cf-7cc92e4258ec tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df" status: 200 len: 1556 microversion: 2.1 time: 0.166038 Sep 16 09:56:38.123854 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 422/846] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:37 2022] GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df => generated 1556 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:56:38.146169 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-5d4f6ab1-6189-4b2c-b280-e86ebff58b91 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:38.146666 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-5d4f6ab1-6189-4b2c-b280-e86ebff58b91 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 2842e80e-fd61-48cf-b415-c5513f6811df] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:38.153905 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5d4f6ab1-6189-4b2c-b280-e86ebff58b91 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:38.154400 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5d4f6ab1-6189-4b2c-b280-e86ebff58b91 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:38.154846 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5d4f6ab1-6189-4b2c-b280-e86ebff58b91 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:38.155543 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5d4f6ab1-6189-4b2c-b280-e86ebff58b91 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:38.156103 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5d4f6ab1-6189-4b2c-b280-e86ebff58b91 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:38.156537 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5d4f6ab1-6189-4b2c-b280-e86ebff58b91 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:38.234782 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-5d4f6ab1-6189-4b2c-b280-e86ebff58b91 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092944 Sep 16 09:56:38.235407 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 425/847] 10.222.0.73 () {58 vars in 1275 bytes} [Fri Sep 16 09:56:38 2022] GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:56:38.328288 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-8bbb2b00-39a4-4fd9-b6d0-03bc7b6fbb87 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:38.329003 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-8bbb2b00-39a4-4fd9-b6d0-03bc7b6fbb87 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:38.340589 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8bbb2b00-39a4-4fd9-b6d0-03bc7b6fbb87 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:38.340589 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8bbb2b00-39a4-4fd9-b6d0-03bc7b6fbb87 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:38.340589 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8bbb2b00-39a4-4fd9-b6d0-03bc7b6fbb87 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:38.341141 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8bbb2b00-39a4-4fd9-b6d0-03bc7b6fbb87 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:38.341638 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8bbb2b00-39a4-4fd9-b6d0-03bc7b6fbb87 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:38.342073 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8bbb2b00-39a4-4fd9-b6d0-03bc7b6fbb87 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:38.607796 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-53bd3808-ecc8-41e2-8ade-16f5f0ee5542 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:38.608406 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-53bd3808-ecc8-41e2-8ade-16f5f0ee5542 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:38.615058 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-53bd3808-ecc8-41e2-8ade-16f5f0ee5542 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:38.615539 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-53bd3808-ecc8-41e2-8ade-16f5f0ee5542 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:38.615966 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-53bd3808-ecc8-41e2-8ade-16f5f0ee5542 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:38.616836 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-53bd3808-ecc8-41e2-8ade-16f5f0ee5542 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:38.617290 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-53bd3808-ecc8-41e2-8ade-16f5f0ee5542 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:38.617739 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-53bd3808-ecc8-41e2-8ade-16f5f0ee5542 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:38.766011 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-53bd3808-ecc8-41e2-8ade-16f5f0ee5542 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:38.776521 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-53bd3808-ecc8-41e2-8ade-16f5f0ee5542 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:38.778264 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-53bd3808-ecc8-41e2-8ade-16f5f0ee5542 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:38.780145 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-53bd3808-ecc8-41e2-8ade-16f5f0ee5542 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1723 microversion: 2.20 time: 0.175796 Sep 16 09:56:38.781052 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 426/848] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:56:38 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 09:56:38.800171 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-8bbb2b00-39a4-4fd9-b6d0-03bc7b6fbb87 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b850cd7b216d4aab865886d20194f322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ebe25211ee4dcb887de8e0c9a03040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:38.809615 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-8bbb2b00-39a4-4fd9-b6d0-03bc7b6fbb87 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a" status: 200 len: 1755 microversion: 2.1 time: 0.485498 Sep 16 09:56:38.810416 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 423/849] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:38 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a => generated 1755 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:56:39.781711 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [req-5f0d50a7-8985-401e-ae35-e5a1ece2c700 req-3b1aa678-4d92-40f5-bdfe-45a113b41ab2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2842e80e-fd61-48cf-b415-c5513f6811df", "tag": "d77fbe69-b931-4dfb-ac17-d581d7f6781e"}]} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:56:39.792934 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-5f0d50a7-8985-401e-ae35-e5a1ece2c700 req-3b1aa678-4d92-40f5-bdfe-45a113b41ab2 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:39.793892 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-5f0d50a7-8985-401e-ae35-e5a1ece2c700 req-3b1aa678-4d92-40f5-bdfe-45a113b41ab2 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:39.793892 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-5f0d50a7-8985-401e-ae35-e5a1ece2c700 req-3b1aa678-4d92-40f5-bdfe-45a113b41ab2 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:39.806739 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.compute.server_external_events [req-5f0d50a7-8985-401e-ae35-e5a1ece2c700 req-3b1aa678-4d92-40f5-bdfe-45a113b41ab2 service nova] Creating event network-changed:d77fbe69-b931-4dfb-ac17-d581d7f6781e for instance 2842e80e-fd61-48cf-b415-c5513f6811df on hv-cinder-79053 Sep 16 09:56:39.807352 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-093bab29-62c3-4359-be18-b84aff1dc422 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:39.808306 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-093bab29-62c3-4359-be18-b84aff1dc422 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:39.811845 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [req-5f0d50a7-8985-401e-ae35-e5a1ece2c700 req-3b1aa678-4d92-40f5-bdfe-45a113b41ab2 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033827 Sep 16 09:56:39.816801 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 427/850] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:56:39.817039 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-093bab29-62c3-4359-be18-b84aff1dc422 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:39.817039 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-093bab29-62c3-4359-be18-b84aff1dc422 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:39.817374 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-093bab29-62c3-4359-be18-b84aff1dc422 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:39.818143 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-093bab29-62c3-4359-be18-b84aff1dc422 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:39.818694 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-093bab29-62c3-4359-be18-b84aff1dc422 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:39.819147 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-093bab29-62c3-4359-be18-b84aff1dc422 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:39.836152 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-5d4f3237-3e50-4119-bbe6-e6d383ca8723 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:39.839807 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-5d4f3237-3e50-4119-bbe6-e6d383ca8723 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:39.844130 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5d4f3237-3e50-4119-bbe6-e6d383ca8723 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:39.844627 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5d4f3237-3e50-4119-bbe6-e6d383ca8723 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:39.845072 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5d4f3237-3e50-4119-bbe6-e6d383ca8723 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:39.846000 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5d4f3237-3e50-4119-bbe6-e6d383ca8723 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:39.846767 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5d4f3237-3e50-4119-bbe6-e6d383ca8723 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:39.847404 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5d4f3237-3e50-4119-bbe6-e6d383ca8723 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:39.968912 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-093bab29-62c3-4359-be18-b84aff1dc422 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:39.977927 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-093bab29-62c3-4359-be18-b84aff1dc422 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:39.979539 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-093bab29-62c3-4359-be18-b84aff1dc422 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:39.980713 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-093bab29-62c3-4359-be18-b84aff1dc422 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1723 microversion: 2.20 time: 0.177606 Sep 16 09:56:39.981488 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 424/851] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:56:39 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 09:56:40.027865 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-5d4f3237-3e50-4119-bbe6-e6d383ca8723 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b850cd7b216d4aab865886d20194f322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ebe25211ee4dcb887de8e0c9a03040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:40.036408 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-5d4f3237-3e50-4119-bbe6-e6d383ca8723 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a" status: 200 len: 1755 microversion: 2.1 time: 0.205442 Sep 16 09:56:40.036984 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 428/852] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:39 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a => generated 1755 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:56:41.008231 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-84fb71ed-b164-4109-a3f3-e378928c71ac tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:41.008855 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-84fb71ed-b164-4109-a3f3-e378928c71ac tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:41.015611 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-84fb71ed-b164-4109-a3f3-e378928c71ac tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:41.016084 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-84fb71ed-b164-4109-a3f3-e378928c71ac tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:41.016531 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-84fb71ed-b164-4109-a3f3-e378928c71ac tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:41.017236 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-84fb71ed-b164-4109-a3f3-e378928c71ac tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:41.017883 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-84fb71ed-b164-4109-a3f3-e378928c71ac tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:41.018267 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-84fb71ed-b164-4109-a3f3-e378928c71ac tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:41.059286 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-5d5c1150-acca-48c9-9527-306223b347dc tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:41.060098 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-5d5c1150-acca-48c9-9527-306223b347dc tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:41.066913 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5d5c1150-acca-48c9-9527-306223b347dc tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:41.067407 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5d5c1150-acca-48c9-9527-306223b347dc tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:41.067848 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5d5c1150-acca-48c9-9527-306223b347dc tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:41.068550 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5d5c1150-acca-48c9-9527-306223b347dc tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:41.069007 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5d5c1150-acca-48c9-9527-306223b347dc tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:41.069447 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5d5c1150-acca-48c9-9527-306223b347dc tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:41.153114 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-84fb71ed-b164-4109-a3f3-e378928c71ac tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:41.162088 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-84fb71ed-b164-4109-a3f3-e378928c71ac tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:41.163516 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-84fb71ed-b164-4109-a3f3-e378928c71ac tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:41.164675 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-84fb71ed-b164-4109-a3f3-e378928c71ac tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1723 microversion: 2.20 time: 0.160636 Sep 16 09:56:41.165283 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 425/853] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:56:41 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:56:41.216350 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-5d5c1150-acca-48c9-9527-306223b347dc tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b850cd7b216d4aab865886d20194f322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ebe25211ee4dcb887de8e0c9a03040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:41.225868 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-5d5c1150-acca-48c9-9527-306223b347dc tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a" status: 200 len: 1755 microversion: 2.1 time: 0.170411 Sep 16 09:56:41.226442 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 429/854] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:41 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:56:42.191688 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-0c070399-9810-49a9-9908-ad31eebaae93 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:42.192314 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-0c070399-9810-49a9-9908-ad31eebaae93 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:42.199589 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0c070399-9810-49a9-9908-ad31eebaae93 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:42.200090 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0c070399-9810-49a9-9908-ad31eebaae93 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:42.200533 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0c070399-9810-49a9-9908-ad31eebaae93 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:42.201312 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0c070399-9810-49a9-9908-ad31eebaae93 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:42.201803 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0c070399-9810-49a9-9908-ad31eebaae93 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:42.202237 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0c070399-9810-49a9-9908-ad31eebaae93 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:42.249976 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-5eee73cd-5a3f-47e4-bc48-65a5660a698e tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:42.250595 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-5eee73cd-5a3f-47e4-bc48-65a5660a698e tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:42.257512 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5eee73cd-5a3f-47e4-bc48-65a5660a698e tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:42.261056 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5eee73cd-5a3f-47e4-bc48-65a5660a698e tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:42.261056 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5eee73cd-5a3f-47e4-bc48-65a5660a698e tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:42.261056 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5eee73cd-5a3f-47e4-bc48-65a5660a698e tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:42.261056 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5eee73cd-5a3f-47e4-bc48-65a5660a698e tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:42.261457 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5eee73cd-5a3f-47e4-bc48-65a5660a698e tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:42.392953 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-0c070399-9810-49a9-9908-ad31eebaae93 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:42.405287 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-0c070399-9810-49a9-9908-ad31eebaae93 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:42.408292 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-0c070399-9810-49a9-9908-ad31eebaae93 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:42.409813 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-0c070399-9810-49a9-9908-ad31eebaae93 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1723 microversion: 2.20 time: 0.223186 Sep 16 09:56:42.416281 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-5eee73cd-5a3f-47e4-bc48-65a5660a698e tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b850cd7b216d4aab865886d20194f322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ebe25211ee4dcb887de8e0c9a03040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:42.422445 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 426/855] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:56:42 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:56:42.427623 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-5eee73cd-5a3f-47e4-bc48-65a5660a698e tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a" status: 200 len: 1755 microversion: 2.1 time: 0.181570 Sep 16 09:56:42.428211 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 430/856] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:42 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:56:42.665230 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-63c1a427-3761-440f-ab8d-b2977f55dcfa tempest-VolumesTestJSON-1951091706 tempest-VolumesTestJSON-1951091706-project] Calling method '.version_select at 0x7ffa71349a60>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:42.717804 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-63c1a427-3761-440f-ab8d-b2977f55dcfa tempest-VolumesTestJSON-1951091706 tempest-VolumesTestJSON-1951091706-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/87ac12a8-6888-40b0-a08d-0a603b3c74f7" status: 200 len: 351 microversion: 2.1 time: 0.056236 Sep 16 09:56:42.718418 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 427/857] 10.222.0.73 () {58 vars in 1245 bytes} [Fri Sep 16 09:56:42 2022] GET /compute/v2.1/os-volumes/87ac12a8-6888-40b0-a08d-0a603b3c74f7 => generated 351 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:56:43.436685 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-b8297e8a-3558-4557-a496-b25b3d37b499 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:43.437227 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-b8297e8a-3558-4557-a496-b25b3d37b499 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:43.443833 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b8297e8a-3558-4557-a496-b25b3d37b499 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:43.444321 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b8297e8a-3558-4557-a496-b25b3d37b499 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:43.444769 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b8297e8a-3558-4557-a496-b25b3d37b499 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:43.445463 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b8297e8a-3558-4557-a496-b25b3d37b499 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:43.446391 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b8297e8a-3558-4557-a496-b25b3d37b499 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:43.446828 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b8297e8a-3558-4557-a496-b25b3d37b499 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:43.458389 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-6dfa165b-8d0c-449d-af5c-3cdae67dd987 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:43.462629 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-6dfa165b-8d0c-449d-af5c-3cdae67dd987 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:43.465357 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6dfa165b-8d0c-449d-af5c-3cdae67dd987 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:43.465949 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6dfa165b-8d0c-449d-af5c-3cdae67dd987 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:43.466460 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6dfa165b-8d0c-449d-af5c-3cdae67dd987 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:43.467202 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6dfa165b-8d0c-449d-af5c-3cdae67dd987 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:43.467660 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6dfa165b-8d0c-449d-af5c-3cdae67dd987 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:43.468087 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6dfa165b-8d0c-449d-af5c-3cdae67dd987 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:43.589147 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-b8297e8a-3558-4557-a496-b25b3d37b499 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:43.597448 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-b8297e8a-3558-4557-a496-b25b3d37b499 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:43.598972 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-b8297e8a-3558-4557-a496-b25b3d37b499 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:43.600356 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-b8297e8a-3558-4557-a496-b25b3d37b499 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1723 microversion: 2.20 time: 0.167632 Sep 16 09:56:43.600992 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 431/858] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:56:43 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:56:43.614683 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-6dfa165b-8d0c-449d-af5c-3cdae67dd987 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b850cd7b216d4aab865886d20194f322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ebe25211ee4dcb887de8e0c9a03040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:43.622953 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-6dfa165b-8d0c-449d-af5c-3cdae67dd987 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a" status: 200 len: 1758 microversion: 2.1 time: 0.169803 Sep 16 09:56:43.623567 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 428/859] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:56:43 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:56:44.385154 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-635c9c5c-3c59-45a8-b41b-be295dd1d463 tempest-VolumesTestJSON-1951091706 tempest-VolumesTestJSON-1951091706-project] Calling method '.version_select at 0x7ffa6daa4700>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:44.435125 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-635c9c5c-3c59-45a8-b41b-be295dd1d463 tempest-VolumesTestJSON-1951091706 tempest-VolumesTestJSON-1951091706-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/cc25e585-5499-4646-83a4-0a5a7e7cb7fb" status: 200 len: 350 microversion: 2.1 time: 0.053669 Sep 16 09:56:44.435698 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 432/860] 10.222.0.73 () {58 vars in 1245 bytes} [Fri Sep 16 09:56:44 2022] GET /compute/v2.1/os-volumes/cc25e585-5499-4646-83a4-0a5a7e7cb7fb => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:56:44.625953 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-6878611d-a970-4f30-9c92-09b28f32bc36 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:44.626578 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-6878611d-a970-4f30-9c92-09b28f32bc36 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:44.633274 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6878611d-a970-4f30-9c92-09b28f32bc36 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:44.633806 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6878611d-a970-4f30-9c92-09b28f32bc36 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:44.634309 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6878611d-a970-4f30-9c92-09b28f32bc36 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:44.635031 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6878611d-a970-4f30-9c92-09b28f32bc36 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:44.635499 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6878611d-a970-4f30-9c92-09b28f32bc36 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:44.635935 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6878611d-a970-4f30-9c92-09b28f32bc36 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:44.639894 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=100 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:56:44.771036 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-6878611d-a970-4f30-9c92-09b28f32bc36 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:44.779462 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-6878611d-a970-4f30-9c92-09b28f32bc36 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:44.780896 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-6878611d-a970-4f30-9c92-09b28f32bc36 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:44.782082 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-6878611d-a970-4f30-9c92-09b28f32bc36 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1723 microversion: 2.20 time: 0.160301 Sep 16 09:56:44.782652 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 429/861] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:56:44 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:56:45.810539 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-876bf4fc-58df-48b4-a4fe-d300bf614e8a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:45.811244 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-876bf4fc-58df-48b4-a4fe-d300bf614e8a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:45.818053 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-876bf4fc-58df-48b4-a4fe-d300bf614e8a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:45.818648 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-876bf4fc-58df-48b4-a4fe-d300bf614e8a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:45.819113 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-876bf4fc-58df-48b4-a4fe-d300bf614e8a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:45.819866 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-876bf4fc-58df-48b4-a4fe-d300bf614e8a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:45.820331 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-876bf4fc-58df-48b4-a4fe-d300bf614e8a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:45.820756 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-876bf4fc-58df-48b4-a4fe-d300bf614e8a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:45.955659 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-876bf4fc-58df-48b4-a4fe-d300bf614e8a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:45.964827 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-876bf4fc-58df-48b4-a4fe-d300bf614e8a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:45.966216 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-876bf4fc-58df-48b4-a4fe-d300bf614e8a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:45.967909 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-876bf4fc-58df-48b4-a4fe-d300bf614e8a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1744 microversion: 2.20 time: 0.161649 Sep 16 09:56:45.976169 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 433/862] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:56:45 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:56:46.102011 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-820eee8e-40a6-4be8-bf27-ab63357db10f tempest-VolumesTestJSON-1951091706 tempest-VolumesTestJSON-1951091706-project] Calling method '.version_select at 0x7ffa7139dc10>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:46.150393 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-820eee8e-40a6-4be8-bf27-ab63357db10f tempest-VolumesTestJSON-1951091706 tempest-VolumesTestJSON-1951091706-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/8a780871-b354-4a7f-b61e-7c68f73979bb" status: 200 len: 351 microversion: 2.1 time: 0.052270 Sep 16 09:56:46.150966 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 430/863] 10.222.0.73 () {58 vars in 1245 bytes} [Fri Sep 16 09:56:46 2022] GET /compute/v2.1/os-volumes/8a780871-b354-4a7f-b61e-7c68f73979bb => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:56:46.164402 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-c6b99180-8130-4a6d-94ea-bd759e23dc21 tempest-VolumesTestJSON-1951091706 tempest-VolumesTestJSON-1951091706-project] Calling method '.version_select at 0x7ffa6da731f0>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:46.249710 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-c6b99180-8130-4a6d-94ea-bd759e23dc21 tempest-VolumesTestJSON-1951091706 tempest-VolumesTestJSON-1951091706-project] 10.222.0.73 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.089463 Sep 16 09:56:46.250285 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 434/864] 10.222.0.73 () {58 vars in 1134 bytes} [Fri Sep 16 09:56:46 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:56:46.264916 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-936b3054-e598-40c6-a64c-c87dc8cc12b1 tempest-VolumesTestJSON-1951091706 tempest-VolumesTestJSON-1951091706-project] Calling method '.version_select at 0x7ffa713493a0>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:46.348331 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-936b3054-e598-40c6-a64c-c87dc8cc12b1 tempest-VolumesTestJSON-1951091706 tempest-VolumesTestJSON-1951091706-project] 10.222.0.73 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.086970 Sep 16 09:56:46.348922 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 431/865] 10.222.0.73 () {58 vars in 1149 bytes} [Fri Sep 16 09:56:46 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:56:46.363168 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-b4a095a8-20d3-490a-8f12-ed1690590ebb tempest-VolumesTestJSON-1951091706 tempest-VolumesTestJSON-1951091706-project] Calling method '.version_select at 0x7ffa6daa48b0>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:46.445111 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-b4a095a8-20d3-490a-8f12-ed1690590ebb tempest-VolumesTestJSON-1951091706 tempest-VolumesTestJSON-1951091706-project] 10.222.0.73 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.085677 Sep 16 09:56:46.445728 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 435/866] 10.222.0.73 () {58 vars in 1134 bytes} [Fri Sep 16 09:56:46 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:56:46.459152 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-89e71a03-facd-44f9-a296-667d79223256 tempest-VolumesTestJSON-1951091706 tempest-VolumesTestJSON-1951091706-project] Calling method '.version_select at 0x7ffa714e0ee0>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:46.542508 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-89e71a03-facd-44f9-a296-667d79223256 tempest-VolumesTestJSON-1951091706 tempest-VolumesTestJSON-1951091706-project] 10.222.0.73 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.087215 Sep 16 09:56:46.543105 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 432/867] 10.222.0.73 () {58 vars in 1167 bytes} [Fri Sep 16 09:56:46 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 09:56:46.557100 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-b83ad7e2-953d-483d-bd2e-37d1dc2ca53c tempest-VolumesTestJSON-1951091706 tempest-VolumesTestJSON-1951091706-project] Calling method '.version_select at 0x7ffa6da20940>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:46.639950 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-b83ad7e2-953d-483d-bd2e-37d1dc2ca53c tempest-VolumesTestJSON-1951091706 tempest-VolumesTestJSON-1951091706-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.086460 Sep 16 09:56:46.640520 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 436/868] 10.222.0.73 () {58 vars in 1170 bytes} [Fri Sep 16 09:56:46 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:56:46.654478 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-e87a8765-e317-44e8-906d-d80f0cf11284 tempest-VolumesTestJSON-1951091706 tempest-VolumesTestJSON-1951091706-project] Calling method '.version_select at 0x7ffa6dc18ca0>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:46.740649 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-e87a8765-e317-44e8-906d-d80f0cf11284 tempest-VolumesTestJSON-1951091706 tempest-VolumesTestJSON-1951091706-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.089803 Sep 16 09:56:46.741225 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 433/869] 10.222.0.73 () {58 vars in 1155 bytes} [Fri Sep 16 09:56:46 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:56:46.754890 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-cb5e5622-506c-413a-8645-6886817d6029 tempest-VolumesTestJSON-1951091706 tempest-VolumesTestJSON-1951091706-project] Calling method '.version_select at 0x7ffa6dbe8430>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:46.842245 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-cb5e5622-506c-413a-8645-6886817d6029 tempest-VolumesTestJSON-1951091706 tempest-VolumesTestJSON-1951091706-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.089607 Sep 16 09:56:46.842245 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 437/870] 10.222.0.73 () {58 vars in 1188 bytes} [Fri Sep 16 09:56:46 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:56:46.855342 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d77d0950-2318-4744-9298-ae22336c3fe3 tempest-VolumesTestJSON-1951091706 tempest-VolumesTestJSON-1951091706-project] Calling method '.version_select at 0x7ffa713245e0>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:46.936281 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-d77d0950-2318-4744-9298-ae22336c3fe3 tempest-VolumesTestJSON-1951091706 tempest-VolumesTestJSON-1951091706-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.085074 Sep 16 09:56:46.936853 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 434/871] 10.222.0.73 () {58 vars in 1155 bytes} [Fri Sep 16 09:56:46 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:56:46.992925 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-6d099e94-68c8-4816-b12b-0c89863ce5e0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:46.993571 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-6d099e94-68c8-4816-b12b-0c89863ce5e0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:47.002172 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6d099e94-68c8-4816-b12b-0c89863ce5e0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:47.002172 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6d099e94-68c8-4816-b12b-0c89863ce5e0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:47.002172 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6d099e94-68c8-4816-b12b-0c89863ce5e0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:47.002172 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6d099e94-68c8-4816-b12b-0c89863ce5e0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:47.003346 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6d099e94-68c8-4816-b12b-0c89863ce5e0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:47.003346 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6d099e94-68c8-4816-b12b-0c89863ce5e0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:47.136424 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-6d099e94-68c8-4816-b12b-0c89863ce5e0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:47.145617 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-6d099e94-68c8-4816-b12b-0c89863ce5e0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:47.147179 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-6d099e94-68c8-4816-b12b-0c89863ce5e0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:47.148339 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-6d099e94-68c8-4816-b12b-0c89863ce5e0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1744 microversion: 2.20 time: 0.159444 Sep 16 09:56:47.148890 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 438/872] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:56:46 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:56:48.175263 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-a773506e-6807-41d2-89a0-94d86e8f6247 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:48.175937 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-a773506e-6807-41d2-89a0-94d86e8f6247 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:48.182684 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a773506e-6807-41d2-89a0-94d86e8f6247 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:48.183174 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a773506e-6807-41d2-89a0-94d86e8f6247 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:48.183615 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a773506e-6807-41d2-89a0-94d86e8f6247 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:48.184320 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a773506e-6807-41d2-89a0-94d86e8f6247 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:48.184786 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a773506e-6807-41d2-89a0-94d86e8f6247 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:48.185219 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a773506e-6807-41d2-89a0-94d86e8f6247 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:48.318483 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-a773506e-6807-41d2-89a0-94d86e8f6247 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:48.326532 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-a773506e-6807-41d2-89a0-94d86e8f6247 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:48.327953 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-a773506e-6807-41d2-89a0-94d86e8f6247 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:48.329104 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-a773506e-6807-41d2-89a0-94d86e8f6247 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1744 microversion: 2.20 time: 0.158491 Sep 16 09:56:48.329679 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 435/873] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:56:48 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:56:49.356782 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-7ee75680-1237-4cb2-a9cf-1d2c3d43061e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:49.357523 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-7ee75680-1237-4cb2-a9cf-1d2c3d43061e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:49.364365 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7ee75680-1237-4cb2-a9cf-1d2c3d43061e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:49.364859 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7ee75680-1237-4cb2-a9cf-1d2c3d43061e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:49.365319 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7ee75680-1237-4cb2-a9cf-1d2c3d43061e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:49.366060 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7ee75680-1237-4cb2-a9cf-1d2c3d43061e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:49.366524 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7ee75680-1237-4cb2-a9cf-1d2c3d43061e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:49.366961 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7ee75680-1237-4cb2-a9cf-1d2c3d43061e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:49.501358 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-7ee75680-1237-4cb2-a9cf-1d2c3d43061e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:49.510382 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-7ee75680-1237-4cb2-a9cf-1d2c3d43061e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:49.511869 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-7ee75680-1237-4cb2-a9cf-1d2c3d43061e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:49.513039 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-7ee75680-1237-4cb2-a9cf-1d2c3d43061e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1744 microversion: 2.20 time: 0.160680 Sep 16 09:56:49.513630 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 439/874] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:56:49 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 09:56:50.538471 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-c4285cae-01e5-4708-bca1-28909f4f30ea tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:50.539118 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-c4285cae-01e5-4708-bca1-28909f4f30ea tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:50.546376 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c4285cae-01e5-4708-bca1-28909f4f30ea tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:50.546872 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c4285cae-01e5-4708-bca1-28909f4f30ea tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:50.547316 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c4285cae-01e5-4708-bca1-28909f4f30ea tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:50.548021 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c4285cae-01e5-4708-bca1-28909f4f30ea tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:50.548580 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c4285cae-01e5-4708-bca1-28909f4f30ea tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:50.548894 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c4285cae-01e5-4708-bca1-28909f4f30ea tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:50.680271 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c4285cae-01e5-4708-bca1-28909f4f30ea tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:50.688405 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c4285cae-01e5-4708-bca1-28909f4f30ea tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:50.689997 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c4285cae-01e5-4708-bca1-28909f4f30ea tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:50.691244 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-c4285cae-01e5-4708-bca1-28909f4f30ea tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1744 microversion: 2.20 time: 0.156612 Sep 16 09:56:50.692660 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 436/875] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:56:50 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:56:51.717334 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-274646b6-3668-42b6-b0e9-86f21524b1af tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:51.718100 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-274646b6-3668-42b6-b0e9-86f21524b1af tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:51.725364 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-274646b6-3668-42b6-b0e9-86f21524b1af tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:51.725886 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-274646b6-3668-42b6-b0e9-86f21524b1af tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:51.726343 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-274646b6-3668-42b6-b0e9-86f21524b1af tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:51.727078 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-274646b6-3668-42b6-b0e9-86f21524b1af tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:51.727540 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-274646b6-3668-42b6-b0e9-86f21524b1af tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:51.728004 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-274646b6-3668-42b6-b0e9-86f21524b1af tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:52.143936 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-274646b6-3668-42b6-b0e9-86f21524b1af tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:52.143936 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-274646b6-3668-42b6-b0e9-86f21524b1af tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:52.144827 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-274646b6-3668-42b6-b0e9-86f21524b1af tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:52.144827 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-274646b6-3668-42b6-b0e9-86f21524b1af tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1739 microversion: 2.20 time: 0.424303 Sep 16 09:56:52.144827 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 440/876] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:56:51 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1739 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:56:52.990092 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-fd082430-9fd3-4dde-bf05-abf9f4ea69a4 req-8c6efaef-9b6d-4504-b89b-25a1c8799fcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0f4a754-d9db-4829-a2f8-677cc9c34fbc", "name": "network-vif-plugged", "status": "completed", "tag": "789fb3b6-eef8-4edd-a929-e88fed92432d"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:56:53.007369 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-fd082430-9fd3-4dde-bf05-abf9f4ea69a4 req-8c6efaef-9b6d-4504-b89b-25a1c8799fcf service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:53.007857 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-fd082430-9fd3-4dde-bf05-abf9f4ea69a4 req-8c6efaef-9b6d-4504-b89b-25a1c8799fcf service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:53.008307 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-fd082430-9fd3-4dde-bf05-abf9f4ea69a4 req-8c6efaef-9b6d-4504-b89b-25a1c8799fcf service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:53.023748 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-fd082430-9fd3-4dde-bf05-abf9f4ea69a4 req-8c6efaef-9b6d-4504-b89b-25a1c8799fcf service nova] Creating event network-vif-plugged:789fb3b6-eef8-4edd-a929-e88fed92432d for instance e0f4a754-d9db-4829-a2f8-677cc9c34fbc on hv-cinder-79053 Sep 16 09:56:53.029839 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-fd082430-9fd3-4dde-bf05-abf9f4ea69a4 req-8c6efaef-9b6d-4504-b89b-25a1c8799fcf service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043052 Sep 16 09:56:53.029839 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 437/877] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:56:53.171511 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-64f6c88c-d49d-4f5c-8bd6-80d77208d9c7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:53.173158 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-64f6c88c-d49d-4f5c-8bd6-80d77208d9c7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:53.179646 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-64f6c88c-d49d-4f5c-8bd6-80d77208d9c7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:53.180401 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-64f6c88c-d49d-4f5c-8bd6-80d77208d9c7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:53.181330 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-64f6c88c-d49d-4f5c-8bd6-80d77208d9c7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:53.182244 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-64f6c88c-d49d-4f5c-8bd6-80d77208d9c7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:53.182714 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-64f6c88c-d49d-4f5c-8bd6-80d77208d9c7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:53.183151 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-64f6c88c-d49d-4f5c-8bd6-80d77208d9c7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:53.351742 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-64f6c88c-d49d-4f5c-8bd6-80d77208d9c7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:53.362440 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-64f6c88c-d49d-4f5c-8bd6-80d77208d9c7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:53.381352 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-64f6c88c-d49d-4f5c-8bd6-80d77208d9c7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:53.383479 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-64f6c88c-d49d-4f5c-8bd6-80d77208d9c7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1739 microversion: 2.20 time: 0.215508 Sep 16 09:56:53.383805 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 441/878] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:56:53 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1739 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:56:54.411094 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-f9d798be-fcf3-4a8a-abe9-e3af4dc6bebe tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:54.412837 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-f9d798be-fcf3-4a8a-abe9-e3af4dc6bebe tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:54.420579 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f9d798be-fcf3-4a8a-abe9-e3af4dc6bebe tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:54.421358 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f9d798be-fcf3-4a8a-abe9-e3af4dc6bebe tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:54.422214 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f9d798be-fcf3-4a8a-abe9-e3af4dc6bebe tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:54.423321 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f9d798be-fcf3-4a8a-abe9-e3af4dc6bebe tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:54.423982 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f9d798be-fcf3-4a8a-abe9-e3af4dc6bebe tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:54.424608 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f9d798be-fcf3-4a8a-abe9-e3af4dc6bebe tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:54.624504 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f9d798be-fcf3-4a8a-abe9-e3af4dc6bebe tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:54.649550 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f9d798be-fcf3-4a8a-abe9-e3af4dc6bebe tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:54.653459 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f9d798be-fcf3-4a8a-abe9-e3af4dc6bebe tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:54.653459 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-f9d798be-fcf3-4a8a-abe9-e3af4dc6bebe tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1739 microversion: 2.20 time: 0.246551 Sep 16 09:56:54.653459 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 438/879] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:56:54 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1739 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 09:56:55.678867 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-0fb337a4-c505-4336-aa7f-8673cbe7cd3f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:55.679587 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-0fb337a4-c505-4336-aa7f-8673cbe7cd3f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:55.686895 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-0fb337a4-c505-4336-aa7f-8673cbe7cd3f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:55.689644 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-0fb337a4-c505-4336-aa7f-8673cbe7cd3f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:55.689644 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-0fb337a4-c505-4336-aa7f-8673cbe7cd3f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:55.689644 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-0fb337a4-c505-4336-aa7f-8673cbe7cd3f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:55.689644 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-0fb337a4-c505-4336-aa7f-8673cbe7cd3f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:55.690002 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-0fb337a4-c505-4336-aa7f-8673cbe7cd3f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:55.846826 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-0fb337a4-c505-4336-aa7f-8673cbe7cd3f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:55.861289 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-0fb337a4-c505-4336-aa7f-8673cbe7cd3f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:55.861289 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-0fb337a4-c505-4336-aa7f-8673cbe7cd3f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:55.861826 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-0fb337a4-c505-4336-aa7f-8673cbe7cd3f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1739 microversion: 2.20 time: 0.186897 Sep 16 09:56:55.862856 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 442/880] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:56:55 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1739 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 09:56:56.893319 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-c425165f-308a-4e5b-93f4-6666f4bf2d12 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:56.895376 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-c425165f-308a-4e5b-93f4-6666f4bf2d12 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:56.902761 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c425165f-308a-4e5b-93f4-6666f4bf2d12 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:56.903360 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c425165f-308a-4e5b-93f4-6666f4bf2d12 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:56.903895 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c425165f-308a-4e5b-93f4-6666f4bf2d12 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:56.904853 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c425165f-308a-4e5b-93f4-6666f4bf2d12 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:56.905376 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c425165f-308a-4e5b-93f4-6666f4bf2d12 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:56.905894 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c425165f-308a-4e5b-93f4-6666f4bf2d12 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:57.088775 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c425165f-308a-4e5b-93f4-6666f4bf2d12 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:57.099068 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c425165f-308a-4e5b-93f4-6666f4bf2d12 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:57.100761 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c425165f-308a-4e5b-93f4-6666f4bf2d12 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:57.102318 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-c425165f-308a-4e5b-93f4-6666f4bf2d12 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1739 microversion: 2.20 time: 0.217435 Sep 16 09:56:57.117902 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 439/881] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:56:56 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1739 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:56:58.129488 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-84891df0-a2cd-4d64-903c-0836d9ffeb55 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:58.130154 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-84891df0-a2cd-4d64-903c-0836d9ffeb55 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:58.132661 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=2 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:56:58.137882 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-84891df0-a2cd-4d64-903c-0836d9ffeb55 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:58.138367 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-84891df0-a2cd-4d64-903c-0836d9ffeb55 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:58.138802 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-84891df0-a2cd-4d64-903c-0836d9ffeb55 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:58.139491 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-84891df0-a2cd-4d64-903c-0836d9ffeb55 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:58.139948 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-84891df0-a2cd-4d64-903c-0836d9ffeb55 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:58.140379 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-84891df0-a2cd-4d64-903c-0836d9ffeb55 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:58.287610 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-84891df0-a2cd-4d64-903c-0836d9ffeb55 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:58.302668 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-84891df0-a2cd-4d64-903c-0836d9ffeb55 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:58.304282 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-84891df0-a2cd-4d64-903c-0836d9ffeb55 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:58.305466 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-84891df0-a2cd-4d64-903c-0836d9ffeb55 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1739 microversion: 2.20 time: 0.180000 Sep 16 09:56:58.306060 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 443/882] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:56:58 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:56:59.335307 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-210cde8d-2b3d-4b97-b71f-9996fb931ab9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:56:59.335923 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-210cde8d-2b3d-4b97-b71f-9996fb931ab9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:56:59.353458 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-210cde8d-2b3d-4b97-b71f-9996fb931ab9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:59.354245 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-210cde8d-2b3d-4b97-b71f-9996fb931ab9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:59.355430 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-210cde8d-2b3d-4b97-b71f-9996fb931ab9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:59.356801 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-210cde8d-2b3d-4b97-b71f-9996fb931ab9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:56:59.357574 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-210cde8d-2b3d-4b97-b71f-9996fb931ab9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:56:59.358202 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-210cde8d-2b3d-4b97-b71f-9996fb931ab9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:56:59.710394 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-210cde8d-2b3d-4b97-b71f-9996fb931ab9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:59.719750 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-210cde8d-2b3d-4b97-b71f-9996fb931ab9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:59.721401 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-210cde8d-2b3d-4b97-b71f-9996fb931ab9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:56:59.723292 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-210cde8d-2b3d-4b97-b71f-9996fb931ab9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1739 microversion: 2.20 time: 0.393089 Sep 16 09:56:59.724935 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 440/883] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:56:59 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1739 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:57:00.750757 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-440843c0-92fa-43aa-9a5c-72ada1d00f49 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:00.752010 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-440843c0-92fa-43aa-9a5c-72ada1d00f49 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:00.759868 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-440843c0-92fa-43aa-9a5c-72ada1d00f49 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:00.760713 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-440843c0-92fa-43aa-9a5c-72ada1d00f49 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:00.761688 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-440843c0-92fa-43aa-9a5c-72ada1d00f49 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:00.762266 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-440843c0-92fa-43aa-9a5c-72ada1d00f49 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:00.762736 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-440843c0-92fa-43aa-9a5c-72ada1d00f49 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:00.763173 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-440843c0-92fa-43aa-9a5c-72ada1d00f49 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:00.967311 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-440843c0-92fa-43aa-9a5c-72ada1d00f49 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:00.977386 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-440843c0-92fa-43aa-9a5c-72ada1d00f49 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:00.986402 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-440843c0-92fa-43aa-9a5c-72ada1d00f49 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:00.987962 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-440843c0-92fa-43aa-9a5c-72ada1d00f49 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1739 microversion: 2.20 time: 0.242474 Sep 16 09:57:00.989053 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 444/884] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:57:00 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1739 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:57:02.013933 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-dcf6f76c-cd3e-44fd-9e80-6d8573f1e08c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:02.014498 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-dcf6f76c-cd3e-44fd-9e80-6d8573f1e08c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:02.020852 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dcf6f76c-cd3e-44fd-9e80-6d8573f1e08c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:02.021345 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dcf6f76c-cd3e-44fd-9e80-6d8573f1e08c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:02.021818 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dcf6f76c-cd3e-44fd-9e80-6d8573f1e08c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:02.022513 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dcf6f76c-cd3e-44fd-9e80-6d8573f1e08c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:02.022970 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dcf6f76c-cd3e-44fd-9e80-6d8573f1e08c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:02.030824 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dcf6f76c-cd3e-44fd-9e80-6d8573f1e08c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:02.192949 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-dcf6f76c-cd3e-44fd-9e80-6d8573f1e08c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:02.203270 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-dcf6f76c-cd3e-44fd-9e80-6d8573f1e08c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:02.204908 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-dcf6f76c-cd3e-44fd-9e80-6d8573f1e08c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:02.206406 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-dcf6f76c-cd3e-44fd-9e80-6d8573f1e08c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1739 microversion: 2.20 time: 0.196490 Sep 16 09:57:02.207705 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 441/885] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:57:02 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1739 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:57:03.244337 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-b00a714b-e528-49c5-92ee-9a37664bd829 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:03.244957 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-b00a714b-e528-49c5-92ee-9a37664bd829 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:03.254675 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b00a714b-e528-49c5-92ee-9a37664bd829 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:03.255165 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b00a714b-e528-49c5-92ee-9a37664bd829 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:03.255601 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b00a714b-e528-49c5-92ee-9a37664bd829 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:03.256344 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b00a714b-e528-49c5-92ee-9a37664bd829 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:03.256802 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b00a714b-e528-49c5-92ee-9a37664bd829 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:03.257228 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b00a714b-e528-49c5-92ee-9a37664bd829 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:03.431704 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-b00a714b-e528-49c5-92ee-9a37664bd829 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:03.439939 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-b00a714b-e528-49c5-92ee-9a37664bd829 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:03.442003 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-b00a714b-e528-49c5-92ee-9a37664bd829 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:03.443159 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-b00a714b-e528-49c5-92ee-9a37664bd829 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1739 microversion: 2.20 time: 0.208986 Sep 16 09:57:03.443711 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 445/886] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:57:03 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1739 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:57:04.471571 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-ecb8a19f-b3bb-4717-9b94-6e9f7f9f6ce3 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:04.472820 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-ecb8a19f-b3bb-4717-9b94-6e9f7f9f6ce3 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:04.479644 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ecb8a19f-b3bb-4717-9b94-6e9f7f9f6ce3 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:04.480140 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ecb8a19f-b3bb-4717-9b94-6e9f7f9f6ce3 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:04.480578 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ecb8a19f-b3bb-4717-9b94-6e9f7f9f6ce3 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:04.481273 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ecb8a19f-b3bb-4717-9b94-6e9f7f9f6ce3 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:04.481772 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ecb8a19f-b3bb-4717-9b94-6e9f7f9f6ce3 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:04.482203 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ecb8a19f-b3bb-4717-9b94-6e9f7f9f6ce3 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:04.650913 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-ecb8a19f-b3bb-4717-9b94-6e9f7f9f6ce3 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:04.659855 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-ecb8a19f-b3bb-4717-9b94-6e9f7f9f6ce3 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:04.661475 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-ecb8a19f-b3bb-4717-9b94-6e9f7f9f6ce3 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:04.662687 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-ecb8a19f-b3bb-4717-9b94-6e9f7f9f6ce3 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1721 microversion: 2.20 time: 0.195004 Sep 16 09:57:04.663251 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 442/887] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:57:04 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1721 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:57:05.691871 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-0c04080d-8524-4c69-ba30-66a97f64b214 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:05.692846 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-0c04080d-8524-4c69-ba30-66a97f64b214 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:05.699449 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-0c04080d-8524-4c69-ba30-66a97f64b214 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:05.699938 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-0c04080d-8524-4c69-ba30-66a97f64b214 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:05.700383 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-0c04080d-8524-4c69-ba30-66a97f64b214 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:05.701078 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-0c04080d-8524-4c69-ba30-66a97f64b214 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:05.701535 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-0c04080d-8524-4c69-ba30-66a97f64b214 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:05.701993 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-0c04080d-8524-4c69-ba30-66a97f64b214 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:05.835819 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-0c04080d-8524-4c69-ba30-66a97f64b214 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:05.844171 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-0c04080d-8524-4c69-ba30-66a97f64b214 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:05.845653 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-0c04080d-8524-4c69-ba30-66a97f64b214 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:05.847563 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-0c04080d-8524-4c69-ba30-66a97f64b214 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1721 microversion: 2.20 time: 0.158906 Sep 16 09:57:05.848198 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 446/888] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:57:05 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:57:06.873327 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-4ab55641-324a-41c7-a37a-597e19b455ae tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:06.873894 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-4ab55641-324a-41c7-a37a-597e19b455ae tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:06.881321 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4ab55641-324a-41c7-a37a-597e19b455ae tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:06.881848 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4ab55641-324a-41c7-a37a-597e19b455ae tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:06.882313 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4ab55641-324a-41c7-a37a-597e19b455ae tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:06.883011 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4ab55641-324a-41c7-a37a-597e19b455ae tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:06.883472 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4ab55641-324a-41c7-a37a-597e19b455ae tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:06.883899 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4ab55641-324a-41c7-a37a-597e19b455ae tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:07.016174 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-4ab55641-324a-41c7-a37a-597e19b455ae tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:07.027611 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-4ab55641-324a-41c7-a37a-597e19b455ae tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:07.029056 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-4ab55641-324a-41c7-a37a-597e19b455ae tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:07.030416 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-4ab55641-324a-41c7-a37a-597e19b455ae tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1724 microversion: 2.20 time: 0.161192 Sep 16 09:57:07.031328 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 443/889] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:57:06 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:57:07.056292 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-bab7e477-1882-4a59-ac5f-aabe30409b3a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a49f3374-e391-4e18-a2b1-53cafb45e82c"}} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:57:07.058610 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-bab7e477-1882-4a59-ac5f-aabe30409b3a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:07.064934 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-bab7e477-1882-4a59-ac5f-aabe30409b3a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:07.065419 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-bab7e477-1882-4a59-ac5f-aabe30409b3a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:07.065914 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-bab7e477-1882-4a59-ac5f-aabe30409b3a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:07.066585 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-bab7e477-1882-4a59-ac5f-aabe30409b3a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:07.067041 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-bab7e477-1882-4a59-ac5f-aabe30409b3a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:07.067468 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-bab7e477-1882-4a59-ac5f-aabe30409b3a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:07.084066 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell1:SELECT=100 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:57:08.163060 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-bab7e477-1882-4a59-ac5f-aabe30409b3a tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "POST /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.110637 Sep 16 09:57:08.163709 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 447/890] 10.222.0.73 () {62 vars in 1364 bytes} [Fri Sep 16 09:57:07 2022] POST /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc/os-volume_attachments => generated 188 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 09:57:08.292857 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-85f5b9f8-a482-441d-b6c8-f65becfe67d7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:08.293414 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-85f5b9f8-a482-441d-b6c8-f65becfe67d7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:08.295716 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_api:SELECT=32 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:57:08.300552 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-85f5b9f8-a482-441d-b6c8-f65becfe67d7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:08.301014 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-85f5b9f8-a482-441d-b6c8-f65becfe67d7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:08.301376 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-85f5b9f8-a482-441d-b6c8-f65becfe67d7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:08.302099 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-85f5b9f8-a482-441d-b6c8-f65becfe67d7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:08.302555 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-85f5b9f8-a482-441d-b6c8-f65becfe67d7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:08.302980 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-85f5b9f8-a482-441d-b6c8-f65becfe67d7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:08.922801 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-85f5b9f8-a482-441d-b6c8-f65becfe67d7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "DELETE /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc/os-volume_attachments/a49f3374-e391-4e18-a2b1-53cafb45e82c" status: 202 len: 0 microversion: 2.20 time: 0.633922 Sep 16 09:57:08.923416 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 444/891] 10.222.0.73 () {60 vars in 1457 bytes} [Fri Sep 16 09:57:08 2022] DELETE /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc/os-volume_attachments/a49f3374-e391-4e18-a2b1-53cafb45e82c => generated 0 bytes in 635 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 16 09:57:08.989412 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-dc937ace-3571-42c2-8907-b294cd83a29c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:57:08.990031 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-dc937ace-3571-42c2-8907-b294cd83a29c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:08.996965 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-dc937ace-3571-42c2-8907-b294cd83a29c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:08.997506 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-dc937ace-3571-42c2-8907-b294cd83a29c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:08.998227 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-dc937ace-3571-42c2-8907-b294cd83a29c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:08.999013 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-dc937ace-3571-42c2-8907-b294cd83a29c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:08.999466 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-dc937ace-3571-42c2-8907-b294cd83a29c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:08.999892 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-dc937ace-3571-42c2-8907-b294cd83a29c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:09.042794 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-288ab45e-3f4c-4194-bd8b-e755a4654efe req-58f6c82a-df76-4a5d-9d83-a7ae0ed77297 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0f4a754-d9db-4829-a2f8-677cc9c34fbc", "name": "network-vif-unplugged", "status": "completed", "tag": "789fb3b6-eef8-4edd-a929-e88fed92432d"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:57:09.054423 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-288ab45e-3f4c-4194-bd8b-e755a4654efe req-58f6c82a-df76-4a5d-9d83-a7ae0ed77297 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:09.054974 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-288ab45e-3f4c-4194-bd8b-e755a4654efe req-58f6c82a-df76-4a5d-9d83-a7ae0ed77297 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:09.055409 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-288ab45e-3f4c-4194-bd8b-e755a4654efe req-58f6c82a-df76-4a5d-9d83-a7ae0ed77297 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:09.066904 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.compute.server_external_events [req-288ab45e-3f4c-4194-bd8b-e755a4654efe req-58f6c82a-df76-4a5d-9d83-a7ae0ed77297 service nova] Unable to find a host for instance e0f4a754-d9db-4829-a2f8-677cc9c34fbc. Dropping event network-vif-unplugged {{(pid=127670) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 16 09:57:09.067894 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-288ab45e-3f4c-4194-bd8b-e755a4654efe req-58f6c82a-df76-4a5d-9d83-a7ae0ed77297 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031280 Sep 16 09:57:09.068801 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 445/892] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 16 09:57:09.149558 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-dc937ace-3571-42c2-8907-b294cd83a29c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127671) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 16 09:57:09.450863 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-dc937ace-3571-42c2-8907-b294cd83a29c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "POST /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc/action" status: 202 len: 0 microversion: 2.20 time: 0.466003 Sep 16 09:57:09.455406 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 448/893] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Sep 16 09:57:08 2022] POST /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc/action => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 16 09:57:09.461768 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-3ad3d817-f16e-4cbc-b746-08c79aedf867 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:09.462453 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-3ad3d817-f16e-4cbc-b746-08c79aedf867 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:09.469449 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3ad3d817-f16e-4cbc-b746-08c79aedf867 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:09.469986 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3ad3d817-f16e-4cbc-b746-08c79aedf867 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:09.470993 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3ad3d817-f16e-4cbc-b746-08c79aedf867 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:09.477338 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3ad3d817-f16e-4cbc-b746-08c79aedf867 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:09.477338 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3ad3d817-f16e-4cbc-b746-08c79aedf867 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:09.477338 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3ad3d817-f16e-4cbc-b746-08c79aedf867 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:09.612939 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-3ad3d817-f16e-4cbc-b746-08c79aedf867 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:09.623276 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-3ad3d817-f16e-4cbc-b746-08c79aedf867 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:09.624725 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-3ad3d817-f16e-4cbc-b746-08c79aedf867 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:09.627106 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-3ad3d817-f16e-4cbc-b746-08c79aedf867 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1672 microversion: 2.20 time: 0.169605 Sep 16 09:57:09.629159 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 446/894] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:57:09 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1672 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:57:10.652857 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-49dfb7c4-5c26-4234-83f6-7a884bb38814 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:10.653470 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-49dfb7c4-5c26-4234-83f6-7a884bb38814 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:10.661310 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-49dfb7c4-5c26-4234-83f6-7a884bb38814 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:10.661837 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-49dfb7c4-5c26-4234-83f6-7a884bb38814 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:10.662286 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-49dfb7c4-5c26-4234-83f6-7a884bb38814 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:10.663041 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-49dfb7c4-5c26-4234-83f6-7a884bb38814 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:10.663590 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-49dfb7c4-5c26-4234-83f6-7a884bb38814 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:10.664068 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-49dfb7c4-5c26-4234-83f6-7a884bb38814 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:10.805526 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-49dfb7c4-5c26-4234-83f6-7a884bb38814 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:10.814500 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-49dfb7c4-5c26-4234-83f6-7a884bb38814 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:10.816928 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-49dfb7c4-5c26-4234-83f6-7a884bb38814 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:10.818231 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-49dfb7c4-5c26-4234-83f6-7a884bb38814 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1672 microversion: 2.20 time: 0.169946 Sep 16 09:57:10.818796 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 449/895] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:57:10 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1672 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:57:11.843879 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-aa484eee-2b22-42bf-95d2-146706a88cc0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:11.844510 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-aa484eee-2b22-42bf-95d2-146706a88cc0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:11.851815 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-aa484eee-2b22-42bf-95d2-146706a88cc0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:11.852356 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-aa484eee-2b22-42bf-95d2-146706a88cc0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:11.853047 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-aa484eee-2b22-42bf-95d2-146706a88cc0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:11.853772 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-aa484eee-2b22-42bf-95d2-146706a88cc0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:11.854224 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-aa484eee-2b22-42bf-95d2-146706a88cc0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:11.854645 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-aa484eee-2b22-42bf-95d2-146706a88cc0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:11.991174 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-aa484eee-2b22-42bf-95d2-146706a88cc0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:11.999429 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-aa484eee-2b22-42bf-95d2-146706a88cc0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:12.000853 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-aa484eee-2b22-42bf-95d2-146706a88cc0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:12.002050 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-aa484eee-2b22-42bf-95d2-146706a88cc0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1730 microversion: 2.20 time: 0.162557 Sep 16 09:57:12.002602 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 447/896] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:57:11 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:57:13.028417 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-27fcba3e-3cab-4038-ac1a-671d5a39f727 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:13.029034 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-27fcba3e-3cab-4038-ac1a-671d5a39f727 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:13.036286 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-27fcba3e-3cab-4038-ac1a-671d5a39f727 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:13.036874 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-27fcba3e-3cab-4038-ac1a-671d5a39f727 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:13.037319 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-27fcba3e-3cab-4038-ac1a-671d5a39f727 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:13.038098 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-27fcba3e-3cab-4038-ac1a-671d5a39f727 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:13.038533 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-27fcba3e-3cab-4038-ac1a-671d5a39f727 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:13.039157 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-27fcba3e-3cab-4038-ac1a-671d5a39f727 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:13.176257 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-27fcba3e-3cab-4038-ac1a-671d5a39f727 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:13.184791 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-27fcba3e-3cab-4038-ac1a-671d5a39f727 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:13.186400 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-27fcba3e-3cab-4038-ac1a-671d5a39f727 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:13.187583 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-27fcba3e-3cab-4038-ac1a-671d5a39f727 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1730 microversion: 2.20 time: 0.163332 Sep 16 09:57:13.188141 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 450/897] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:57:13 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:57:14.216209 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-43fc1f2d-1d79-4903-a00b-6dcb30f01cf7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:14.218177 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-43fc1f2d-1d79-4903-a00b-6dcb30f01cf7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:14.228677 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-43fc1f2d-1d79-4903-a00b-6dcb30f01cf7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:14.229179 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-43fc1f2d-1d79-4903-a00b-6dcb30f01cf7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:14.229658 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-43fc1f2d-1d79-4903-a00b-6dcb30f01cf7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:14.230380 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-43fc1f2d-1d79-4903-a00b-6dcb30f01cf7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:14.230843 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-43fc1f2d-1d79-4903-a00b-6dcb30f01cf7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:14.231275 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-43fc1f2d-1d79-4903-a00b-6dcb30f01cf7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:14.385370 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-43fc1f2d-1d79-4903-a00b-6dcb30f01cf7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:14.396607 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-43fc1f2d-1d79-4903-a00b-6dcb30f01cf7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:14.398088 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-43fc1f2d-1d79-4903-a00b-6dcb30f01cf7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:14.399341 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-43fc1f2d-1d79-4903-a00b-6dcb30f01cf7 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1730 microversion: 2.20 time: 0.188809 Sep 16 09:57:14.400152 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 448/898] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:57:14 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1730 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:57:15.426403 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-5c1a7933-cb54-44f5-b911-8f7af4750e90 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:15.426994 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-5c1a7933-cb54-44f5-b911-8f7af4750e90 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:15.433534 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5c1a7933-cb54-44f5-b911-8f7af4750e90 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:15.434037 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5c1a7933-cb54-44f5-b911-8f7af4750e90 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:15.434471 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5c1a7933-cb54-44f5-b911-8f7af4750e90 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:15.435152 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5c1a7933-cb54-44f5-b911-8f7af4750e90 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:15.435601 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5c1a7933-cb54-44f5-b911-8f7af4750e90 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:15.436023 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5c1a7933-cb54-44f5-b911-8f7af4750e90 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:15.579616 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-5c1a7933-cb54-44f5-b911-8f7af4750e90 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:15.593968 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-5c1a7933-cb54-44f5-b911-8f7af4750e90 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:15.595408 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-5c1a7933-cb54-44f5-b911-8f7af4750e90 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:15.596625 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-5c1a7933-cb54-44f5-b911-8f7af4750e90 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1730 microversion: 2.20 time: 0.174807 Sep 16 09:57:15.601621 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 451/899] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:57:15 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 09:57:16.626730 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-c18b7d03-dc96-4d4e-8b1c-81ed0010b4a0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:16.627463 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-c18b7d03-dc96-4d4e-8b1c-81ed0010b4a0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:16.634681 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c18b7d03-dc96-4d4e-8b1c-81ed0010b4a0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:16.635399 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c18b7d03-dc96-4d4e-8b1c-81ed0010b4a0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:16.636071 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c18b7d03-dc96-4d4e-8b1c-81ed0010b4a0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:16.636902 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c18b7d03-dc96-4d4e-8b1c-81ed0010b4a0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:16.637439 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c18b7d03-dc96-4d4e-8b1c-81ed0010b4a0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:16.637966 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c18b7d03-dc96-4d4e-8b1c-81ed0010b4a0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:16.640955 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:57:16.812035 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c18b7d03-dc96-4d4e-8b1c-81ed0010b4a0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:16.821855 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c18b7d03-dc96-4d4e-8b1c-81ed0010b4a0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:16.823361 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c18b7d03-dc96-4d4e-8b1c-81ed0010b4a0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:16.838143 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-c18b7d03-dc96-4d4e-8b1c-81ed0010b4a0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1730 microversion: 2.20 time: 0.203763 Sep 16 09:57:16.838143 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 449/900] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:57:16 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1730 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:57:17.863053 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-d52a629e-9791-409c-b39a-87426c593e92 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:17.863755 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-d52a629e-9791-409c-b39a-87426c593e92 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:17.870483 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d52a629e-9791-409c-b39a-87426c593e92 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:17.870995 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d52a629e-9791-409c-b39a-87426c593e92 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:17.871436 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d52a629e-9791-409c-b39a-87426c593e92 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:17.872153 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d52a629e-9791-409c-b39a-87426c593e92 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:17.872613 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d52a629e-9791-409c-b39a-87426c593e92 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:17.873046 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d52a629e-9791-409c-b39a-87426c593e92 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:18.018608 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-d52a629e-9791-409c-b39a-87426c593e92 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:18.027312 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-d52a629e-9791-409c-b39a-87426c593e92 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:18.042811 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-d52a629e-9791-409c-b39a-87426c593e92 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:18.042811 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-d52a629e-9791-409c-b39a-87426c593e92 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1730 microversion: 2.20 time: 0.171898 Sep 16 09:57:18.042811 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 452/901] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:57:17 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:57:19.056481 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-329359c9-2630-4471-90b2-4ab0066d4065 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:19.057104 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-329359c9-2630-4471-90b2-4ab0066d4065 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:19.064092 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-329359c9-2630-4471-90b2-4ab0066d4065 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:19.064620 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-329359c9-2630-4471-90b2-4ab0066d4065 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:19.065633 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-329359c9-2630-4471-90b2-4ab0066d4065 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:19.066695 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-329359c9-2630-4471-90b2-4ab0066d4065 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:19.067166 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-329359c9-2630-4471-90b2-4ab0066d4065 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:19.067599 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-329359c9-2630-4471-90b2-4ab0066d4065 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:19.250507 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-329359c9-2630-4471-90b2-4ab0066d4065 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:19.273672 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-329359c9-2630-4471-90b2-4ab0066d4065 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:19.273672 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-329359c9-2630-4471-90b2-4ab0066d4065 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:19.274179 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-329359c9-2630-4471-90b2-4ab0066d4065 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1730 microversion: 2.20 time: 0.222096 Sep 16 09:57:19.279683 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 450/902] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:57:19 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1730 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:57:20.304764 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-60c83b62-6a64-458b-91ba-7f1e7555fee3 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:20.305427 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-60c83b62-6a64-458b-91ba-7f1e7555fee3 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:20.312109 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-60c83b62-6a64-458b-91ba-7f1e7555fee3 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:20.312592 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-60c83b62-6a64-458b-91ba-7f1e7555fee3 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:20.313027 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-60c83b62-6a64-458b-91ba-7f1e7555fee3 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:20.313761 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-60c83b62-6a64-458b-91ba-7f1e7555fee3 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:20.314343 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-60c83b62-6a64-458b-91ba-7f1e7555fee3 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:20.314946 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-60c83b62-6a64-458b-91ba-7f1e7555fee3 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:20.480359 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-60c83b62-6a64-458b-91ba-7f1e7555fee3 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:20.482749 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-60c83b62-6a64-458b-91ba-7f1e7555fee3 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:20.484142 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-60c83b62-6a64-458b-91ba-7f1e7555fee3 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:20.485526 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-60c83b62-6a64-458b-91ba-7f1e7555fee3 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1730 microversion: 2.20 time: 0.184959 Sep 16 09:57:20.486180 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 453/903] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:57:20 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1730 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:57:21.511151 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-ca43af11-be59-477b-836b-633ecd285f28 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:21.511857 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-ca43af11-be59-477b-836b-633ecd285f28 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:21.521575 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ca43af11-be59-477b-836b-633ecd285f28 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:21.522162 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ca43af11-be59-477b-836b-633ecd285f28 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:21.522505 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ca43af11-be59-477b-836b-633ecd285f28 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:21.523414 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ca43af11-be59-477b-836b-633ecd285f28 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:21.524033 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ca43af11-be59-477b-836b-633ecd285f28 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:21.524638 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ca43af11-be59-477b-836b-633ecd285f28 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:21.704435 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-ca43af11-be59-477b-836b-633ecd285f28 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:21.714158 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-ca43af11-be59-477b-836b-633ecd285f28 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:21.715615 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-ca43af11-be59-477b-836b-633ecd285f28 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:21.716819 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-ca43af11-be59-477b-836b-633ecd285f28 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1730 microversion: 2.20 time: 0.209670 Sep 16 09:57:21.717377 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 451/904] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:57:21 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1730 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:57:22.747600 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-97dfd010-a6e6-476c-aac8-70a2b9abf14c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:22.747600 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-97dfd010-a6e6-476c-aac8-70a2b9abf14c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:22.750675 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-97dfd010-a6e6-476c-aac8-70a2b9abf14c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:22.751160 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-97dfd010-a6e6-476c-aac8-70a2b9abf14c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:22.751600 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-97dfd010-a6e6-476c-aac8-70a2b9abf14c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:22.752291 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-97dfd010-a6e6-476c-aac8-70a2b9abf14c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:22.753294 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-97dfd010-a6e6-476c-aac8-70a2b9abf14c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:22.753758 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-97dfd010-a6e6-476c-aac8-70a2b9abf14c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:22.882514 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-97dfd010-a6e6-476c-aac8-70a2b9abf14c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:22.890516 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-97dfd010-a6e6-476c-aac8-70a2b9abf14c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:22.891966 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-97dfd010-a6e6-476c-aac8-70a2b9abf14c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:22.893737 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-97dfd010-a6e6-476c-aac8-70a2b9abf14c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1730 microversion: 2.20 time: 0.153597 Sep 16 09:57:22.894295 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 454/905] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:57:22 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:57:23.666198 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-83dde4c6-3bb8-4201-a1c8-a43714408ef2 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:23.666740 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-83dde4c6-3bb8-4201-a1c8-a43714408ef2 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 2842e80e-fd61-48cf-b415-c5513f6811df] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:23.673291 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-83dde4c6-3bb8-4201-a1c8-a43714408ef2 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:23.673818 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-83dde4c6-3bb8-4201-a1c8-a43714408ef2 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:23.674320 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-83dde4c6-3bb8-4201-a1c8-a43714408ef2 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:23.675179 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-83dde4c6-3bb8-4201-a1c8-a43714408ef2 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:23.675634 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-83dde4c6-3bb8-4201-a1c8-a43714408ef2 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:23.676061 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-83dde4c6-3bb8-4201-a1c8-a43714408ef2 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:23.698703 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-83dde4c6-3bb8-4201-a1c8-a43714408ef2 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df/ips" status: 200 len: 149 microversion: 2.1 time: 0.036412 Sep 16 09:57:23.699252 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 452/906] 10.222.0.73 () {58 vars in 1248 bytes} [Fri Sep 16 09:57:23 2022] GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:57:23.900530 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-e8736b92-5375-4aee-90e8-f6c7b392e7b8 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-181057337"}} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:57:23.901207 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-e8736b92-5375-4aee-90e8-f6c7b392e7b8 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:23.907591 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e8736b92-5375-4aee-90e8-f6c7b392e7b8 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:23.908071 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e8736b92-5375-4aee-90e8-f6c7b392e7b8 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:23.908505 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e8736b92-5375-4aee-90e8-f6c7b392e7b8 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:23.910048 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e8736b92-5375-4aee-90e8-f6c7b392e7b8 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:23.910512 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e8736b92-5375-4aee-90e8-f6c7b392e7b8 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:23.910939 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e8736b92-5375-4aee-90e8-f6c7b392e7b8 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:23.918834 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-34585bf1-226e-4775-aa97-d7613011970c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:23.919389 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-34585bf1-226e-4775-aa97-d7613011970c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:23.925989 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-34585bf1-226e-4775-aa97-d7613011970c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:23.926491 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-34585bf1-226e-4775-aa97-d7613011970c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:23.926941 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-34585bf1-226e-4775-aa97-d7613011970c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:23.927701 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-34585bf1-226e-4775-aa97-d7613011970c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:23.928110 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-34585bf1-226e-4775-aa97-d7613011970c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:23.928544 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-34585bf1-226e-4775-aa97-d7613011970c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:24.040950 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.network.security_group_api [None req-e8736b92-5375-4aee-90e8-f6c7b392e7b8 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Removing security group ac5927e3-c811-4909-a073-19e742068fdc from port dedee03b-d367-4e51-b2cd-813deda5dc38 Sep 16 09:57:24.062686 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-34585bf1-226e-4775-aa97-d7613011970c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:24.071617 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-34585bf1-226e-4775-aa97-d7613011970c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:24.073044 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-34585bf1-226e-4775-aa97-d7613011970c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:24.074241 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-34585bf1-226e-4775-aa97-d7613011970c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1730 microversion: 2.20 time: 0.159602 Sep 16 09:57:24.074869 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 453/907] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:57:23 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 09:57:24.444651 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-e8736b92-5375-4aee-90e8-f6c7b392e7b8 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "POST /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a/action" status: 202 len: 0 microversion: 2.1 time: 0.547927 Sep 16 09:57:24.448636 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 455/908] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Sep 16 09:57:23 2022] POST /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a/action => generated 0 bytes in 550 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 09:57:24.556865 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-cfc536c9-ff08-4e19-80ca-81d477b05f3e req-96173e8e-e273-49d1-a804-a4cfe70d3506 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a74942a9-2ed1-4058-b2f6-6def2204784a", "tag": "dedee03b-d367-4e51-b2cd-813deda5dc38"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:57:24.575299 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-cfc536c9-ff08-4e19-80ca-81d477b05f3e req-96173e8e-e273-49d1-a804-a4cfe70d3506 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:24.575506 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-cfc536c9-ff08-4e19-80ca-81d477b05f3e req-96173e8e-e273-49d1-a804-a4cfe70d3506 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:24.575923 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-cfc536c9-ff08-4e19-80ca-81d477b05f3e req-96173e8e-e273-49d1-a804-a4cfe70d3506 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:24.593801 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-cfc536c9-ff08-4e19-80ca-81d477b05f3e req-96173e8e-e273-49d1-a804-a4cfe70d3506 service nova] Creating event network-changed:dedee03b-d367-4e51-b2cd-813deda5dc38 for instance a74942a9-2ed1-4058-b2f6-6def2204784a on hv-cinder-79053 Sep 16 09:57:24.599466 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-cfc536c9-ff08-4e19-80ca-81d477b05f3e req-96173e8e-e273-49d1-a804-a4cfe70d3506 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125754 Sep 16 09:57:24.600078 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 454/909] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 09:57:25.108504 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-b1c21733-e2ff-4f3a-9712-734e408354d4 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:25.108504 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-b1c21733-e2ff-4f3a-9712-734e408354d4 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:25.109530 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b1c21733-e2ff-4f3a-9712-734e408354d4 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:25.110065 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b1c21733-e2ff-4f3a-9712-734e408354d4 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:25.111061 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b1c21733-e2ff-4f3a-9712-734e408354d4 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:25.112571 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b1c21733-e2ff-4f3a-9712-734e408354d4 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:25.113398 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b1c21733-e2ff-4f3a-9712-734e408354d4 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:25.114047 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b1c21733-e2ff-4f3a-9712-734e408354d4 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:25.323195 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-b9451561-8f3d-4967-a272-f5faa2236184 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "efda2cee-75ec-4bd9-a0ba-5884c26dade6"}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:57:25.325865 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-b9451561-8f3d-4967-a272-f5faa2236184 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 2842e80e-fd61-48cf-b415-c5513f6811df] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:25.333089 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b9451561-8f3d-4967-a272-f5faa2236184 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:25.337230 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b9451561-8f3d-4967-a272-f5faa2236184 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:25.337230 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b9451561-8f3d-4967-a272-f5faa2236184 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:25.337230 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b9451561-8f3d-4967-a272-f5faa2236184 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:25.337230 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b9451561-8f3d-4967-a272-f5faa2236184 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:25.337834 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b9451561-8f3d-4967-a272-f5faa2236184 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:25.549661 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-b1c21733-e2ff-4f3a-9712-734e408354d4 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:25.558560 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-b1c21733-e2ff-4f3a-9712-734e408354d4 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:25.560132 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-b1c21733-e2ff-4f3a-9712-734e408354d4 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:25.561458 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-b1c21733-e2ff-4f3a-9712-734e408354d4 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1730 microversion: 2.20 time: 0.465733 Sep 16 09:57:25.565599 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 456/910] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:57:25 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1730 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:57:26.047189 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-f63fa5da-811e-42af-a666-c76be965861a tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:26.053872 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-f63fa5da-811e-42af-a666-c76be965861a tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:26.055100 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f63fa5da-811e-42af-a666-c76be965861a tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:26.055709 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f63fa5da-811e-42af-a666-c76be965861a tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:26.056140 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f63fa5da-811e-42af-a666-c76be965861a tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:26.056876 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f63fa5da-811e-42af-a666-c76be965861a tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:26.057368 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f63fa5da-811e-42af-a666-c76be965861a tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:26.063733 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f63fa5da-811e-42af-a666-c76be965861a tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:26.116256 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-b9451561-8f3d-4967-a272-f5faa2236184 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "POST /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.797795 Sep 16 09:57:26.117423 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 455/911] 10.222.0.73 () {60 vars in 1323 bytes} [Fri Sep 16 09:57:25 2022] POST /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df/os-volume_attachments => generated 194 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 09:57:26.164545 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.objects.instance [None req-f63fa5da-811e-42af-a666-c76be965861a tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lazy-loading 'services' on Instance uuid a74942a9-2ed1-4058-b2f6-6def2204784a {{(pid=127671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 09:57:26.432818 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-f63fa5da-811e-42af-a666-c76be965861a tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "DELETE /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a/os-volume_attachments/ed559bbe-10eb-441e-99fd-133587afff02" status: 202 len: 0 microversion: 2.1 time: 0.389312 Sep 16 09:57:26.433849 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 457/912] 10.222.0.73 () {58 vars in 1416 bytes} [Fri Sep 16 09:57:26 2022] DELETE /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a/os-volume_attachments/ed559bbe-10eb-441e-99fd-133587afff02 => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 09:57:26.442860 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-7ece81ff-7753-40b7-b003-7871f4b56a1c tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:26.445861 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-7ece81ff-7753-40b7-b003-7871f4b56a1c tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:26.452942 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7ece81ff-7753-40b7-b003-7871f4b56a1c tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:26.454331 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7ece81ff-7753-40b7-b003-7871f4b56a1c tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:26.454766 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7ece81ff-7753-40b7-b003-7871f4b56a1c tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:26.455702 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7ece81ff-7753-40b7-b003-7871f4b56a1c tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:26.456767 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7ece81ff-7753-40b7-b003-7871f4b56a1c tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:26.457488 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7ece81ff-7753-40b7-b003-7871f4b56a1c tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:26.491939 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-7ece81ff-7753-40b7-b003-7871f4b56a1c tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053484 Sep 16 09:57:26.492519 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 456/913] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Sep 16 09:57:26 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 09:57:26.588706 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-798b77d1-e3d2-4be5-989c-8fa4c5b654be tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:26.589847 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-798b77d1-e3d2-4be5-989c-8fa4c5b654be tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:26.597853 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-798b77d1-e3d2-4be5-989c-8fa4c5b654be tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:26.598362 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-798b77d1-e3d2-4be5-989c-8fa4c5b654be tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:26.598784 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-798b77d1-e3d2-4be5-989c-8fa4c5b654be tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:26.599780 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-798b77d1-e3d2-4be5-989c-8fa4c5b654be tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:26.600424 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-798b77d1-e3d2-4be5-989c-8fa4c5b654be tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:26.600855 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-798b77d1-e3d2-4be5-989c-8fa4c5b654be tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:26.622601 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-1a3032da-8ecb-4427-8868-6b302593cf16 req-6b38ecc7-c95c-4a30-a69d-801c6eae8872 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a74942a9-2ed1-4058-b2f6-6def2204784a", "tag": "dedee03b-d367-4e51-b2cd-813deda5dc38"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:57:26.633597 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-1a3032da-8ecb-4427-8868-6b302593cf16 req-6b38ecc7-c95c-4a30-a69d-801c6eae8872 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:26.634220 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-1a3032da-8ecb-4427-8868-6b302593cf16 req-6b38ecc7-c95c-4a30-a69d-801c6eae8872 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:26.634724 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-1a3032da-8ecb-4427-8868-6b302593cf16 req-6b38ecc7-c95c-4a30-a69d-801c6eae8872 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:26.647733 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-1a3032da-8ecb-4427-8868-6b302593cf16 req-6b38ecc7-c95c-4a30-a69d-801c6eae8872 service nova] Creating event network-changed:dedee03b-d367-4e51-b2cd-813deda5dc38 for instance a74942a9-2ed1-4058-b2f6-6def2204784a on hv-cinder-79053 Sep 16 09:57:26.653051 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-1a3032da-8ecb-4427-8868-6b302593cf16 req-6b38ecc7-c95c-4a30-a69d-801c6eae8872 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034334 Sep 16 09:57:26.653998 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 457/914] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 09:57:26.762960 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-798b77d1-e3d2-4be5-989c-8fa4c5b654be tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:26.772247 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-798b77d1-e3d2-4be5-989c-8fa4c5b654be tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:26.773739 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-798b77d1-e3d2-4be5-989c-8fa4c5b654be tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:26.774929 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-798b77d1-e3d2-4be5-989c-8fa4c5b654be tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1730 microversion: 2.20 time: 0.190861 Sep 16 09:57:26.775470 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 458/915] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:57:26 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1730 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:57:27.137174 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-b8bc3c32-2f53-4e79-9bad-a0630340014a req-98608beb-97e1-47b7-967b-30d1b0b4c472 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0f4a754-d9db-4829-a2f8-677cc9c34fbc", "name": "network-vif-plugged", "status": "completed", "tag": "789fb3b6-eef8-4edd-a929-e88fed92432d"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:57:27.147751 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-b8bc3c32-2f53-4e79-9bad-a0630340014a req-98608beb-97e1-47b7-967b-30d1b0b4c472 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:27.148611 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-b8bc3c32-2f53-4e79-9bad-a0630340014a req-98608beb-97e1-47b7-967b-30d1b0b4c472 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:27.149268 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-b8bc3c32-2f53-4e79-9bad-a0630340014a req-98608beb-97e1-47b7-967b-30d1b0b4c472 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:27.169119 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-b8bc3c32-2f53-4e79-9bad-a0630340014a req-98608beb-97e1-47b7-967b-30d1b0b4c472 service nova] Creating event network-vif-plugged:789fb3b6-eef8-4edd-a929-e88fed92432d for instance e0f4a754-d9db-4829-a2f8-677cc9c34fbc on hv-cinder-79053 Sep 16 09:57:27.169119 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-b8bc3c32-2f53-4e79-9bad-a0630340014a req-98608beb-97e1-47b7-967b-30d1b0b4c472 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036956 Sep 16 09:57:27.169747 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 458/916] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:57:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:57:27.504841 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-3516f9e1-0750-465b-9a37-64aa00932eb5 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:27.507667 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-3516f9e1-0750-465b-9a37-64aa00932eb5 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:27.514814 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3516f9e1-0750-465b-9a37-64aa00932eb5 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:27.515588 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3516f9e1-0750-465b-9a37-64aa00932eb5 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:27.515754 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3516f9e1-0750-465b-9a37-64aa00932eb5 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:27.516435 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3516f9e1-0750-465b-9a37-64aa00932eb5 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:27.516897 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3516f9e1-0750-465b-9a37-64aa00932eb5 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:27.519069 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3516f9e1-0750-465b-9a37-64aa00932eb5 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:27.548790 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-3516f9e1-0750-465b-9a37-64aa00932eb5 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048297 Sep 16 09:57:27.550276 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 459/917] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Sep 16 09:57:27 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:57:27.802048 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-60edd4d2-421c-4f28-89b0-f2ab5b6fb7f9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:27.802830 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-60edd4d2-421c-4f28-89b0-f2ab5b6fb7f9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:27.809417 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-60edd4d2-421c-4f28-89b0-f2ab5b6fb7f9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:27.810021 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-60edd4d2-421c-4f28-89b0-f2ab5b6fb7f9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:27.810473 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-60edd4d2-421c-4f28-89b0-f2ab5b6fb7f9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:27.811157 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-60edd4d2-421c-4f28-89b0-f2ab5b6fb7f9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:27.811611 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-60edd4d2-421c-4f28-89b0-f2ab5b6fb7f9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:27.812035 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-60edd4d2-421c-4f28-89b0-f2ab5b6fb7f9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:27.954103 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-60edd4d2-421c-4f28-89b0-f2ab5b6fb7f9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:27.963654 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-60edd4d2-421c-4f28-89b0-f2ab5b6fb7f9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:27.965198 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-60edd4d2-421c-4f28-89b0-f2ab5b6fb7f9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:27.966406 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-60edd4d2-421c-4f28-89b0-f2ab5b6fb7f9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1730 microversion: 2.20 time: 0.168779 Sep 16 09:57:27.966966 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 459/918] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:57:27 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:57:28.561039 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-66b36724-8b4d-4288-b33b-1add19273764 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:28.563239 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-66b36724-8b4d-4288-b33b-1add19273764 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:28.569934 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-66b36724-8b4d-4288-b33b-1add19273764 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:28.570430 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-66b36724-8b4d-4288-b33b-1add19273764 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:28.570880 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-66b36724-8b4d-4288-b33b-1add19273764 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:28.571585 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-66b36724-8b4d-4288-b33b-1add19273764 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:28.572050 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-66b36724-8b4d-4288-b33b-1add19273764 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:28.572483 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-66b36724-8b4d-4288-b33b-1add19273764 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:28.576299 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=5,nova_cell1:UPDATE=5 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:57:28.601832 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-66b36724-8b4d-4288-b33b-1add19273764 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044738 Sep 16 09:57:28.602654 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 460/919] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Sep 16 09:57:28 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:57:28.991724 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-b951a400-e50e-4f97-8def-b971512d38b1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:28.992365 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-b951a400-e50e-4f97-8def-b971512d38b1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:28.998875 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b951a400-e50e-4f97-8def-b971512d38b1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:28.999360 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b951a400-e50e-4f97-8def-b971512d38b1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:28.999792 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b951a400-e50e-4f97-8def-b971512d38b1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:29.000484 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b951a400-e50e-4f97-8def-b971512d38b1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:29.000943 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b951a400-e50e-4f97-8def-b971512d38b1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:29.001360 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b951a400-e50e-4f97-8def-b971512d38b1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:29.174987 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-b951a400-e50e-4f97-8def-b971512d38b1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:29.188380 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-b951a400-e50e-4f97-8def-b971512d38b1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:29.190806 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-b951a400-e50e-4f97-8def-b971512d38b1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:29.192338 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-b951a400-e50e-4f97-8def-b971512d38b1 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1730 microversion: 2.20 time: 0.204462 Sep 16 09:57:29.193605 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 460/920] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:57:28 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1730 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:57:29.615787 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-c888077f-2474-43ff-bb17-a6ab637b5b87 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:29.618281 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-c888077f-2474-43ff-bb17-a6ab637b5b87 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:29.625820 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c888077f-2474-43ff-bb17-a6ab637b5b87 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:29.626306 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c888077f-2474-43ff-bb17-a6ab637b5b87 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:29.626768 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c888077f-2474-43ff-bb17-a6ab637b5b87 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:29.627715 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c888077f-2474-43ff-bb17-a6ab637b5b87 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:29.628243 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c888077f-2474-43ff-bb17-a6ab637b5b87 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:29.628766 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c888077f-2474-43ff-bb17-a6ab637b5b87 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:29.660600 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-c888077f-2474-43ff-bb17-a6ab637b5b87 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050079 Sep 16 09:57:29.661174 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 461/921] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Sep 16 09:57:29 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:57:30.224319 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-86197c52-3239-4523-a509-d0760920b35c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:30.224934 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-86197c52-3239-4523-a509-d0760920b35c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:30.231712 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-86197c52-3239-4523-a509-d0760920b35c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:30.232213 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-86197c52-3239-4523-a509-d0760920b35c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:30.232660 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-86197c52-3239-4523-a509-d0760920b35c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:30.233365 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-86197c52-3239-4523-a509-d0760920b35c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:30.233879 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-86197c52-3239-4523-a509-d0760920b35c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:30.234315 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-86197c52-3239-4523-a509-d0760920b35c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:30.414564 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-86197c52-3239-4523-a509-d0760920b35c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:30.423193 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-86197c52-3239-4523-a509-d0760920b35c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:30.426315 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-86197c52-3239-4523-a509-d0760920b35c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:30.427578 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-86197c52-3239-4523-a509-d0760920b35c tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1730 microversion: 2.20 time: 0.208682 Sep 16 09:57:30.428360 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 461/922] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:57:30 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1730 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:57:30.672731 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-da362cb0-0a75-4461-8987-f9a761e8dda5 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:30.675523 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-da362cb0-0a75-4461-8987-f9a761e8dda5 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:30.682174 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-da362cb0-0a75-4461-8987-f9a761e8dda5 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:30.682659 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-da362cb0-0a75-4461-8987-f9a761e8dda5 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:30.683099 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-da362cb0-0a75-4461-8987-f9a761e8dda5 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:30.683786 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-da362cb0-0a75-4461-8987-f9a761e8dda5 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:30.684240 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-da362cb0-0a75-4461-8987-f9a761e8dda5 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:30.684661 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-da362cb0-0a75-4461-8987-f9a761e8dda5 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:30.715095 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-da362cb0-0a75-4461-8987-f9a761e8dda5 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046442 Sep 16 09:57:30.715674 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 462/923] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Sep 16 09:57:30 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:57:31.453052 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-543d8f62-8460-4123-9cd8-132b4542a10f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:31.453764 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-543d8f62-8460-4123-9cd8-132b4542a10f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:31.460770 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-543d8f62-8460-4123-9cd8-132b4542a10f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:31.461187 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-543d8f62-8460-4123-9cd8-132b4542a10f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:31.461652 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-543d8f62-8460-4123-9cd8-132b4542a10f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:31.462444 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-543d8f62-8460-4123-9cd8-132b4542a10f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:31.462899 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-543d8f62-8460-4123-9cd8-132b4542a10f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:31.463322 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-543d8f62-8460-4123-9cd8-132b4542a10f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:31.603850 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-543d8f62-8460-4123-9cd8-132b4542a10f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:31.612691 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-543d8f62-8460-4123-9cd8-132b4542a10f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:31.614277 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-543d8f62-8460-4123-9cd8-132b4542a10f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:31.615535 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-543d8f62-8460-4123-9cd8-132b4542a10f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1717 microversion: 2.20 time: 0.166394 Sep 16 09:57:31.616098 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 462/924] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:57:31 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1717 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:57:31.727522 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-97d4e4ac-399b-4abb-9725-baf253afdde8 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:31.730326 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-97d4e4ac-399b-4abb-9725-baf253afdde8 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:31.737936 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-97d4e4ac-399b-4abb-9725-baf253afdde8 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:31.738431 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-97d4e4ac-399b-4abb-9725-baf253afdde8 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:31.738869 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-97d4e4ac-399b-4abb-9725-baf253afdde8 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:31.739571 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-97d4e4ac-399b-4abb-9725-baf253afdde8 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:31.740030 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-97d4e4ac-399b-4abb-9725-baf253afdde8 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:31.740458 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-97d4e4ac-399b-4abb-9725-baf253afdde8 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:31.770064 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-97d4e4ac-399b-4abb-9725-baf253afdde8 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046583 Sep 16 09:57:31.770629 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 463/925] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Sep 16 09:57:31 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:57:32.782384 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-feb1374b-f849-4c12-839f-05922d8f8be4 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:32.784705 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-feb1374b-f849-4c12-839f-05922d8f8be4 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:32.791699 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-feb1374b-f849-4c12-839f-05922d8f8be4 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:32.792188 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-feb1374b-f849-4c12-839f-05922d8f8be4 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:32.792631 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-feb1374b-f849-4c12-839f-05922d8f8be4 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:32.793370 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-feb1374b-f849-4c12-839f-05922d8f8be4 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:32.793856 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-feb1374b-f849-4c12-839f-05922d8f8be4 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:32.794290 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-feb1374b-f849-4c12-839f-05922d8f8be4 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:32.825219 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-feb1374b-f849-4c12-839f-05922d8f8be4 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046945 Sep 16 09:57:32.825796 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 463/926] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Sep 16 09:57:32 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:57:33.838420 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-8205c525-7bf1-49ec-b6ff-8be9bc7aeaf9 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:33.840763 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-8205c525-7bf1-49ec-b6ff-8be9bc7aeaf9 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:33.842325 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-ffbdd777-93f0-4804-8013-5d00b5d3408c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:33.845535 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-ffbdd777-93f0-4804-8013-5d00b5d3408c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 2842e80e-fd61-48cf-b415-c5513f6811df] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:33.845711 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:57:33.848077 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8205c525-7bf1-49ec-b6ff-8be9bc7aeaf9 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:33.848575 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8205c525-7bf1-49ec-b6ff-8be9bc7aeaf9 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:33.849581 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8205c525-7bf1-49ec-b6ff-8be9bc7aeaf9 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:33.850567 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8205c525-7bf1-49ec-b6ff-8be9bc7aeaf9 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:33.850712 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ffbdd777-93f0-4804-8013-5d00b5d3408c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:33.851037 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8205c525-7bf1-49ec-b6ff-8be9bc7aeaf9 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:33.851154 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ffbdd777-93f0-4804-8013-5d00b5d3408c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:33.851466 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8205c525-7bf1-49ec-b6ff-8be9bc7aeaf9 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:33.851580 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ffbdd777-93f0-4804-8013-5d00b5d3408c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:33.852602 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ffbdd777-93f0-4804-8013-5d00b5d3408c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:33.853341 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ffbdd777-93f0-4804-8013-5d00b5d3408c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:33.853960 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ffbdd777-93f0-4804-8013-5d00b5d3408c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:33.886475 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-8205c525-7bf1-49ec-b6ff-8be9bc7aeaf9 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052444 Sep 16 09:57:33.887049 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 464/927] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Sep 16 09:57:33 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:57:33.938420 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.objects.instance [None req-ffbdd777-93f0-4804-8013-5d00b5d3408c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lazy-loading 'services' on Instance uuid 2842e80e-fd61-48cf-b415-c5513f6811df {{(pid=127670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 09:57:34.153925 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-ffbdd777-93f0-4804-8013-5d00b5d3408c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "DELETE /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df/os-volume_attachments/efda2cee-75ec-4bd9-a0ba-5884c26dade6" status: 202 len: 0 microversion: 2.1 time: 0.314858 Sep 16 09:57:34.154978 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 464/928] 10.222.0.73 () {58 vars in 1416 bytes} [Fri Sep 16 09:57:33 2022] DELETE /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df/os-volume_attachments/efda2cee-75ec-4bd9-a0ba-5884c26dade6 => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 09:57:34.169369 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-a6d36b7d-8797-4b8a-9c05-d633a4addfd9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:34.171761 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-a6d36b7d-8797-4b8a-9c05-d633a4addfd9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 2842e80e-fd61-48cf-b415-c5513f6811df] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:34.186752 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a6d36b7d-8797-4b8a-9c05-d633a4addfd9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:34.189033 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a6d36b7d-8797-4b8a-9c05-d633a4addfd9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:34.189033 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a6d36b7d-8797-4b8a-9c05-d633a4addfd9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:34.189900 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a6d36b7d-8797-4b8a-9c05-d633a4addfd9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:34.190724 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a6d36b7d-8797-4b8a-9c05-d633a4addfd9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:34.191506 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a6d36b7d-8797-4b8a-9c05-d633a4addfd9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:34.227915 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-a6d36b7d-8797-4b8a-9c05-d633a4addfd9 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062411 Sep 16 09:57:34.228371 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 465/929] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Sep 16 09:57:34 2022] GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:57:34.900298 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-99d6bd7e-ab5b-4bc0-871e-abf508008a5d tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:34.902645 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-99d6bd7e-ab5b-4bc0-871e-abf508008a5d tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:34.908789 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-99d6bd7e-ab5b-4bc0-871e-abf508008a5d tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:34.909272 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-99d6bd7e-ab5b-4bc0-871e-abf508008a5d tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:34.909743 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-99d6bd7e-ab5b-4bc0-871e-abf508008a5d tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:34.910434 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-99d6bd7e-ab5b-4bc0-871e-abf508008a5d tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:34.910968 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-99d6bd7e-ab5b-4bc0-871e-abf508008a5d tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:34.911392 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-99d6bd7e-ab5b-4bc0-871e-abf508008a5d tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:34.939733 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-99d6bd7e-ab5b-4bc0-871e-abf508008a5d tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045098 Sep 16 09:57:34.940382 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 465/930] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Sep 16 09:57:34 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 09:57:34.951830 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-52106efd-8159-4290-a3cc-b8554103deaa tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:34.952331 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-52106efd-8159-4290-a3cc-b8554103deaa tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:34.960031 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-52106efd-8159-4290-a3cc-b8554103deaa tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:34.960626 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-52106efd-8159-4290-a3cc-b8554103deaa tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:34.961084 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-52106efd-8159-4290-a3cc-b8554103deaa tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:34.961874 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-52106efd-8159-4290-a3cc-b8554103deaa tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:34.962357 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-52106efd-8159-4290-a3cc-b8554103deaa tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:34.962786 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-52106efd-8159-4290-a3cc-b8554103deaa tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:35.041375 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.wsgi [None req-52106efd-8159-4290-a3cc-b8554103deaa tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] HTTP exception thrown: Instance a74942a9-2ed1-4058-b2f6-6def2204784a is not attached to volume ed559bbe-10eb-441e-99fd-133587afff02 Sep 16 09:57:35.049948 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-52106efd-8159-4290-a3cc-b8554103deaa tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Request method failure captured: Sep 16 09:57:35.049948 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: request: DELETE /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a/os-volume_attachments/ed559bbe-10eb-441e-99fd-133587afff02 HTTP/1.1 Sep 16 09:57:35.049948 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept: application/json Sep 16 09:57:35.049948 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept-Encoding: identity Sep 16 09:57:35.049948 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Connection: close Sep 16 09:57:35.049948 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Length: 0 Sep 16 09:57:35.049948 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Type: application/json Sep 16 09:57:35.049948 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Host: 10.222.0.73 Sep 16 09:57:35.049948 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Openstack-System-Scope: None Sep 16 09:57:35.049948 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: User-Agent: python-urllib3/1.26.12 Sep 16 09:57:35.049948 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Auth-Token: gAAAAABjJEfoc55Qm5_blEXMBoZlSL5HRSDtCw8cVEn0ba98s-fKdo6_7RDqbUFrNvob6AGetNFO_j2ALx_QHZGFy_TCAay-DkBdrapLavm2Uk2eVvihXC78rZGjF-IO2HzKoWqPWbchlxaPELN4pd_bj46KDJbNGuGR1nmBN-3nDT8gxzsXGf4 Sep 16 09:57:35.049948 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Id: None Sep 16 09:57:35.049948 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Name: None Sep 16 09:57:35.049948 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Identity-Status: Confirmed Sep 16 09:57:35.049948 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Is-Admin-Project: True Sep 16 09:57:35.049948 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Id: default Sep 16 09:57:35.049948 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Name: Default Sep 16 09:57:35.049948 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Id: c3ebe25211ee4dcb887de8e0c9a03040 Sep 16 09:57:35.049948 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Name: tempest-TestMinimumBasicScenario-13493145 Sep 16 09:57:35.049948 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Role: reader,member Sep 16 09:57:35.049948 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Roles: reader,member Sep 16 09:57:35.051633 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c3ebe25211ee4dcb887de8e0c9a03040"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_c3ebe25211ee4dcb887de8e0c9a03040", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c3ebe25211ee4dcb887de8e0c9a03040"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/c3ebe25211ee4dcb887de8e0c9a03040"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 09:57:35.051633 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant: tempest-TestMinimumBasicScenario-13493145 Sep 16 09:57:35.051633 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Id: c3ebe25211ee4dcb887de8e0c9a03040 Sep 16 09:57:35.051633 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Name: tempest-TestMinimumBasicScenario-13493145 Sep 16 09:57:35.051633 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User: tempest-TestMinimumBasicScenario-13493145-project Sep 16 09:57:35.051633 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Id: default Sep 16 09:57:35.051633 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Name: Default Sep 16 09:57:35.051633 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Id: b850cd7b216d4aab865886d20194f322 Sep 16 09:57:35.051633 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Name: tempest-TestMinimumBasicScenario-13493145-project Sep 16 09:57:35.051633 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: method: > Sep 16 09:57:35.051633 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: exception: Instance a74942a9-2ed1-4058-b2f6-6def2204784a is not attached to volume ed559bbe-10eb-441e-99fd-133587afff02 Sep 16 09:57:35.053095 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: action_args: {'server_id': 'a74942a9-2ed1-4058-b2f6-6def2204784a', 'id': 'ed559bbe-10eb-441e-99fd-133587afff02'} Sep 16 09:57:35.053095 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 09:57:35.053095 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:57:35.053095 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 16 09:57:35.053095 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 16 09:57:35.053095 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 09:57:35.053095 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 09:57:35.053095 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 16 09:57:35.053095 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 16 09:57:35.053095 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ed559bbe-10eb-441e-99fd-133587afff02. Sep 16 09:57:35.053095 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:57:35.053095 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:57:35.053095 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:57:35.053095 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:57:35.053095 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:57:35.053095 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:57:35.053095 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 09:57:35.053095 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 09:57:35.053095 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 09:57:35.054714 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:57:35.054714 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 16 09:57:35.054714 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 16 09:57:35.054714 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a74942a9-2ed1-4058-b2f6-6def2204784a is not attached to volume ed559bbe-10eb-441e-99fd-133587afff02 Sep 16 09:57:35.054714 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:57:35.054714 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:57:35.054714 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:57:35.054714 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:57:35.054714 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:57:35.054714 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:57:35.054714 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 09:57:35.054714 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 09:57:35.054714 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a74942a9-2ed1-4058-b2f6-6def2204784a is not attached to volume ed559bbe-10eb-441e-99fd-133587afff02 Sep 16 09:57:35.054714 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:57:35.054714 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-52106efd-8159-4290-a3cc-b8554103deaa tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Returning 404 to user: Instance a74942a9-2ed1-4058-b2f6-6def2204784a is not attached to volume ed559bbe-10eb-441e-99fd-133587afff02 {{(pid=127671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 09:57:35.055938 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-52106efd-8159-4290-a3cc-b8554103deaa tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "DELETE /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a/os-volume_attachments/ed559bbe-10eb-441e-99fd-133587afff02" status: 404 len: 154 microversion: 2.1 time: 0.103614 Sep 16 09:57:35.055938 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 466/931] 10.222.0.73 () {58 vars in 1416 bytes} [Fri Sep 16 09:57:34 2022] DELETE /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a/os-volume_attachments/ed559bbe-10eb-441e-99fd-133587afff02 => generated 154 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 09:57:35.241470 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-098550b6-a80d-4a73-8246-47189d0dcc5c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:35.243804 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-098550b6-a80d-4a73-8246-47189d0dcc5c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 2842e80e-fd61-48cf-b415-c5513f6811df] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:35.250995 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-098550b6-a80d-4a73-8246-47189d0dcc5c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:35.251581 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-098550b6-a80d-4a73-8246-47189d0dcc5c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:35.252211 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-098550b6-a80d-4a73-8246-47189d0dcc5c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:35.253155 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-098550b6-a80d-4a73-8246-47189d0dcc5c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:35.253648 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-098550b6-a80d-4a73-8246-47189d0dcc5c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:35.254113 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-098550b6-a80d-4a73-8246-47189d0dcc5c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:35.258012 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:57:35.288344 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-098550b6-a80d-4a73-8246-47189d0dcc5c tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050727 Sep 16 09:57:35.288906 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 466/932] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Sep 16 09:57:35 2022] GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 09:57:35.360108 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-03b0600d-8bb7-42b6-b1a4-685a4b1c2c6b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:35.363418 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-03b0600d-8bb7-42b6-b1a4-685a4b1c2c6b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 2842e80e-fd61-48cf-b415-c5513f6811df] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:35.366768 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-03b0600d-8bb7-42b6-b1a4-685a4b1c2c6b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:35.367263 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-03b0600d-8bb7-42b6-b1a4-685a4b1c2c6b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:35.367706 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-03b0600d-8bb7-42b6-b1a4-685a4b1c2c6b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:35.368408 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-03b0600d-8bb7-42b6-b1a4-685a4b1c2c6b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:35.368867 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-03b0600d-8bb7-42b6-b1a4-685a4b1c2c6b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:35.369373 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-03b0600d-8bb7-42b6-b1a4-685a4b1c2c6b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:35.394857 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-03b0600d-8bb7-42b6-b1a4-685a4b1c2c6b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 2842e80e-fd61-48cf-b415-c5513f6811df] Going to try to terminate instance {{(pid=127671) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 09:57:35.688904 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-03b0600d-8bb7-42b6-b1a4-685a4b1c2c6b tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "DELETE /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df" status: 204 len: 0 microversion: 2.1 time: 0.332426 Sep 16 09:57:35.689517 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 467/933] 10.222.0.73 () {58 vars in 1239 bytes} [Fri Sep 16 09:57:35 2022] DELETE /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 09:57:35.698973 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-5e8178e0-a627-43d3-aef8-b2672fc41bde tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:35.699600 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-5e8178e0-a627-43d3-aef8-b2672fc41bde tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 2842e80e-fd61-48cf-b415-c5513f6811df] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:35.706209 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5e8178e0-a627-43d3-aef8-b2672fc41bde tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:35.706696 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5e8178e0-a627-43d3-aef8-b2672fc41bde tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:35.707140 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5e8178e0-a627-43d3-aef8-b2672fc41bde tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:35.708171 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5e8178e0-a627-43d3-aef8-b2672fc41bde tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:35.708500 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5e8178e0-a627-43d3-aef8-b2672fc41bde tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:35.709923 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5e8178e0-a627-43d3-aef8-b2672fc41bde tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:35.848684 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-5e8178e0-a627-43d3-aef8-b2672fc41bde tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:35.866042 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-5e8178e0-a627-43d3-aef8-b2672fc41bde tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df" status: 200 len: 1680 microversion: 2.1 time: 0.163720 Sep 16 09:57:35.869345 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 467/934] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:57:35 2022] GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df => generated 1680 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:57:36.315656 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-97e397b3-19b1-44f2-8fa9-eafb6a524ac8 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:36.316239 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-97e397b3-19b1-44f2-8fa9-eafb6a524ac8 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:36.326426 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-97e397b3-19b1-44f2-8fa9-eafb6a524ac8 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:36.326911 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-97e397b3-19b1-44f2-8fa9-eafb6a524ac8 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:36.327351 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-97e397b3-19b1-44f2-8fa9-eafb6a524ac8 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:36.328038 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-97e397b3-19b1-44f2-8fa9-eafb6a524ac8 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:36.328490 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-97e397b3-19b1-44f2-8fa9-eafb6a524ac8 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:36.328909 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-97e397b3-19b1-44f2-8fa9-eafb6a524ac8 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:36.356610 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-97e397b3-19b1-44f2-8fa9-eafb6a524ac8 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Going to try to terminate instance {{(pid=127671) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 09:57:36.603453 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-97e397b3-19b1-44f2-8fa9-eafb6a524ac8 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "DELETE /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a" status: 204 len: 0 microversion: 2.1 time: 0.291719 Sep 16 09:57:36.604037 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 468/935] 10.222.0.73 () {58 vars in 1239 bytes} [Fri Sep 16 09:57:36 2022] DELETE /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 09:57:36.613760 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-fd20d4cd-e83f-418a-a990-da0726d99d3c tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:36.614375 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-fd20d4cd-e83f-418a-a990-da0726d99d3c tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:36.622407 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fd20d4cd-e83f-418a-a990-da0726d99d3c tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:36.622900 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fd20d4cd-e83f-418a-a990-da0726d99d3c tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:36.623344 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fd20d4cd-e83f-418a-a990-da0726d99d3c tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:36.624049 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fd20d4cd-e83f-418a-a990-da0726d99d3c tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:36.629812 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fd20d4cd-e83f-418a-a990-da0726d99d3c tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:36.629812 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fd20d4cd-e83f-418a-a990-da0726d99d3c tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:36.758341 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-fd20d4cd-e83f-418a-a990-da0726d99d3c tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b850cd7b216d4aab865886d20194f322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ebe25211ee4dcb887de8e0c9a03040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:36.766106 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-fd20d4cd-e83f-418a-a990-da0726d99d3c tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a" status: 200 len: 1553 microversion: 2.1 time: 0.156198 Sep 16 09:57:36.766668 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 468/936] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:57:36 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:57:36.890889 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-296032a7-ee15-4bc3-a9ee-79b1de015c55 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:36.891586 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-296032a7-ee15-4bc3-a9ee-79b1de015c55 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 2842e80e-fd61-48cf-b415-c5513f6811df] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:36.898683 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-296032a7-ee15-4bc3-a9ee-79b1de015c55 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:36.899171 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-296032a7-ee15-4bc3-a9ee-79b1de015c55 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:36.899592 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-296032a7-ee15-4bc3-a9ee-79b1de015c55 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:36.900296 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-296032a7-ee15-4bc3-a9ee-79b1de015c55 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:36.900746 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-296032a7-ee15-4bc3-a9ee-79b1de015c55 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:36.901181 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-296032a7-ee15-4bc3-a9ee-79b1de015c55 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:37.040653 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-296032a7-ee15-4bc3-a9ee-79b1de015c55 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:37.048365 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-296032a7-ee15-4bc3-a9ee-79b1de015c55 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df" status: 200 len: 1680 microversion: 2.1 time: 0.161684 Sep 16 09:57:37.048924 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 469/937] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:57:36 2022] GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:57:37.789911 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-87ee7c59-9c28-4bb8-9e01-a8b865908a07 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:37.790474 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-87ee7c59-9c28-4bb8-9e01-a8b865908a07 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:37.796968 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-87ee7c59-9c28-4bb8-9e01-a8b865908a07 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:37.797445 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-87ee7c59-9c28-4bb8-9e01-a8b865908a07 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:37.797906 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-87ee7c59-9c28-4bb8-9e01-a8b865908a07 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:37.798592 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-87ee7c59-9c28-4bb8-9e01-a8b865908a07 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:37.799043 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-87ee7c59-9c28-4bb8-9e01-a8b865908a07 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:37.799465 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-87ee7c59-9c28-4bb8-9e01-a8b865908a07 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:37.929345 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-87ee7c59-9c28-4bb8-9e01-a8b865908a07 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b850cd7b216d4aab865886d20194f322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ebe25211ee4dcb887de8e0c9a03040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:37.936909 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-87ee7c59-9c28-4bb8-9e01-a8b865908a07 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a" status: 200 len: 1553 microversion: 2.1 time: 0.151254 Sep 16 09:57:37.937469 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 469/938] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:57:37 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:57:38.072341 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-2a67a930-ca56-417a-87a6-c9e1ec03388d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:38.072964 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-2a67a930-ca56-417a-87a6-c9e1ec03388d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 2842e80e-fd61-48cf-b415-c5513f6811df] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:38.079448 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2a67a930-ca56-417a-87a6-c9e1ec03388d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:38.079940 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2a67a930-ca56-417a-87a6-c9e1ec03388d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:38.080385 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2a67a930-ca56-417a-87a6-c9e1ec03388d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:38.081080 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2a67a930-ca56-417a-87a6-c9e1ec03388d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:38.081571 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2a67a930-ca56-417a-87a6-c9e1ec03388d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:38.082003 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2a67a930-ca56-417a-87a6-c9e1ec03388d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:38.214250 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-2a67a930-ca56-417a-87a6-c9e1ec03388d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:38.221888 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-2a67a930-ca56-417a-87a6-c9e1ec03388d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df" status: 200 len: 1680 microversion: 2.1 time: 0.154020 Sep 16 09:57:38.222448 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 470/939] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:57:38 2022] GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:57:38.960638 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-eb1808bf-1bf9-4f84-b96e-946465669074 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:38.961402 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-eb1808bf-1bf9-4f84-b96e-946465669074 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:38.964495 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_api:SELECT=52 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:57:38.969373 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-eb1808bf-1bf9-4f84-b96e-946465669074 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:38.969920 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-eb1808bf-1bf9-4f84-b96e-946465669074 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:38.970367 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-eb1808bf-1bf9-4f84-b96e-946465669074 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:38.971156 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-eb1808bf-1bf9-4f84-b96e-946465669074 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:38.971620 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-eb1808bf-1bf9-4f84-b96e-946465669074 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:38.972054 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-eb1808bf-1bf9-4f84-b96e-946465669074 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:39.244574 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-a3635ff8-387b-42ec-a799-697901bd5781 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:39.245169 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-a3635ff8-387b-42ec-a799-697901bd5781 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 2842e80e-fd61-48cf-b415-c5513f6811df] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:39.251566 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a3635ff8-387b-42ec-a799-697901bd5781 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:39.252278 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a3635ff8-387b-42ec-a799-697901bd5781 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:39.252713 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a3635ff8-387b-42ec-a799-697901bd5781 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:39.253412 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a3635ff8-387b-42ec-a799-697901bd5781 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:39.253896 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a3635ff8-387b-42ec-a799-697901bd5781 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:39.254347 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a3635ff8-387b-42ec-a799-697901bd5781 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:39.258767 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-eb1808bf-1bf9-4f84-b96e-946465669074 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b850cd7b216d4aab865886d20194f322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ebe25211ee4dcb887de8e0c9a03040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:39.271677 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-eb1808bf-1bf9-4f84-b96e-946465669074 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a" status: 200 len: 1553 microversion: 2.1 time: 0.315152 Sep 16 09:57:39.272259 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 470/940] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:57:38 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a => generated 1553 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:57:39.399956 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-a3635ff8-387b-42ec-a799-697901bd5781 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:39.408100 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-a3635ff8-387b-42ec-a799-697901bd5781 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df" status: 200 len: 1680 microversion: 2.1 time: 0.167575 Sep 16 09:57:39.408673 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 471/941] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:57:39 2022] GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:57:40.295992 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-bf2ea3f1-9764-4844-afaa-c672be26b134 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:40.296698 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-bf2ea3f1-9764-4844-afaa-c672be26b134 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:40.306870 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bf2ea3f1-9764-4844-afaa-c672be26b134 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:40.308126 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bf2ea3f1-9764-4844-afaa-c672be26b134 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:40.308707 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bf2ea3f1-9764-4844-afaa-c672be26b134 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:40.309911 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bf2ea3f1-9764-4844-afaa-c672be26b134 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:40.310479 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bf2ea3f1-9764-4844-afaa-c672be26b134 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:40.311151 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bf2ea3f1-9764-4844-afaa-c672be26b134 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:40.345904 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [req-2349d6b7-ab81-42e8-ac62-9e6cc866903d req-472341e4-617b-4cdb-b382-9a9d69606991 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a74942a9-2ed1-4058-b2f6-6def2204784a", "name": "network-vif-deleted", "tag": "dedee03b-d367-4e51-b2cd-813deda5dc38"}]} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:57:40.359944 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-2349d6b7-ab81-42e8-ac62-9e6cc866903d req-472341e4-617b-4cdb-b382-9a9d69606991 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:40.366724 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-2349d6b7-ab81-42e8-ac62-9e6cc866903d req-472341e4-617b-4cdb-b382-9a9d69606991 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:40.366724 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-2349d6b7-ab81-42e8-ac62-9e6cc866903d req-472341e4-617b-4cdb-b382-9a9d69606991 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:40.374638 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.compute.server_external_events [req-2349d6b7-ab81-42e8-ac62-9e6cc866903d req-472341e4-617b-4cdb-b382-9a9d69606991 service nova] Creating event network-vif-deleted:dedee03b-d367-4e51-b2cd-813deda5dc38 for instance a74942a9-2ed1-4058-b2f6-6def2204784a on hv-cinder-79053 Sep 16 09:57:40.380241 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [req-2349d6b7-ab81-42e8-ac62-9e6cc866903d req-472341e4-617b-4cdb-b382-9a9d69606991 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037766 Sep 16 09:57:40.382590 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 472/942] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:57:40.435438 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-bf2ea3f1-9764-4844-afaa-c672be26b134 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b850cd7b216d4aab865886d20194f322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ebe25211ee4dcb887de8e0c9a03040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:40.445746 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-bf2ea3f1-9764-4844-afaa-c672be26b134 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a" status: 200 len: 1511 microversion: 2.1 time: 0.153883 Sep 16 09:57:40.448512 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-4f7c3aba-8c9c-4465-a145-c8b24d524f12 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:40.449499 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-4f7c3aba-8c9c-4465-a145-c8b24d524f12 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 2842e80e-fd61-48cf-b415-c5513f6811df] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:40.452657 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 471/943] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:57:40 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a => generated 1511 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:57:40.472084 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4f7c3aba-8c9c-4465-a145-c8b24d524f12 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:40.472517 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4f7c3aba-8c9c-4465-a145-c8b24d524f12 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:40.472951 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4f7c3aba-8c9c-4465-a145-c8b24d524f12 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:40.473793 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4f7c3aba-8c9c-4465-a145-c8b24d524f12 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:40.474399 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4f7c3aba-8c9c-4465-a145-c8b24d524f12 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:40.474829 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4f7c3aba-8c9c-4465-a145-c8b24d524f12 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:40.544129 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-4f7c3aba-8c9c-4465-a145-c8b24d524f12 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:40.552490 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-4f7c3aba-8c9c-4465-a145-c8b24d524f12 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df" status: 200 len: 1613 microversion: 2.1 time: 0.121763 Sep 16 09:57:40.553061 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 473/944] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:57:40 2022] GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df => generated 1613 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:57:41.474930 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-3cd6e3f9-76ba-4b1a-9d86-40c9b21d8860 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:41.476094 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-3cd6e3f9-76ba-4b1a-9d86-40c9b21d8860 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:41.483072 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3cd6e3f9-76ba-4b1a-9d86-40c9b21d8860 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:41.483801 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3cd6e3f9-76ba-4b1a-9d86-40c9b21d8860 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:41.484246 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3cd6e3f9-76ba-4b1a-9d86-40c9b21d8860 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:41.484963 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3cd6e3f9-76ba-4b1a-9d86-40c9b21d8860 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:41.485427 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3cd6e3f9-76ba-4b1a-9d86-40c9b21d8860 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:41.485912 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3cd6e3f9-76ba-4b1a-9d86-40c9b21d8860 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:41.519942 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3cd6e3f9-76ba-4b1a-9d86-40c9b21d8860 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:41.520438 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3cd6e3f9-76ba-4b1a-9d86-40c9b21d8860 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:41.520895 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3cd6e3f9-76ba-4b1a-9d86-40c9b21d8860 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:41.521344 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.objects.instance [None req-3cd6e3f9-76ba-4b1a-9d86-40c9b21d8860 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lazy-loading 'fault' on Instance uuid a74942a9-2ed1-4058-b2f6-6def2204784a {{(pid=127670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 09:57:41.579159 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-1c935830-59bc-4e8e-bd44-4c9e2ca404b5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:41.579678 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-3cd6e3f9-76ba-4b1a-9d86-40c9b21d8860 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b850cd7b216d4aab865886d20194f322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ebe25211ee4dcb887de8e0c9a03040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:41.579832 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-1c935830-59bc-4e8e-bd44-4c9e2ca404b5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 2842e80e-fd61-48cf-b415-c5513f6811df] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:41.586707 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1c935830-59bc-4e8e-bd44-4c9e2ca404b5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:41.587469 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1c935830-59bc-4e8e-bd44-4c9e2ca404b5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:41.587910 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1c935830-59bc-4e8e-bd44-4c9e2ca404b5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:41.588619 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1c935830-59bc-4e8e-bd44-4c9e2ca404b5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:41.589080 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1c935830-59bc-4e8e-bd44-4c9e2ca404b5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:41.589511 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1c935830-59bc-4e8e-bd44-4c9e2ca404b5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:41.589966 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-3cd6e3f9-76ba-4b1a-9d86-40c9b21d8860 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a" status: 200 len: 1347 microversion: 2.1 time: 0.118840 Sep 16 09:57:41.590666 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 472/945] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:57:41 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a => generated 1347 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:57:41.593927 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:57:41.625012 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1c935830-59bc-4e8e-bd44-4c9e2ca404b5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:41.625790 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1c935830-59bc-4e8e-bd44-4c9e2ca404b5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:41.626401 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1c935830-59bc-4e8e-bd44-4c9e2ca404b5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:41.626861 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.objects.instance [None req-1c935830-59bc-4e8e-bd44-4c9e2ca404b5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lazy-loading 'fault' on Instance uuid 2842e80e-fd61-48cf-b415-c5513f6811df {{(pid=127671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 09:57:41.696472 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-1c935830-59bc-4e8e-bd44-4c9e2ca404b5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dca5726e89343828e25def6e6c274bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007587f92646f686881c2e1bfb7b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:57:41.705990 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-1c935830-59bc-4e8e-bd44-4c9e2ca404b5 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df" status: 200 len: 1331 microversion: 2.1 time: 0.132091 Sep 16 09:57:41.706739 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 474/946] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:57:41 2022] GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df => generated 1331 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:57:42.407947 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-d64a9c82-ea33-40e0-8fe0-7caf2febd189 req-ec24aa6e-3dfb-438e-a252-3e64a8898132 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2842e80e-fd61-48cf-b415-c5513f6811df", "name": "network-vif-deleted", "tag": "d77fbe69-b931-4dfb-ac17-d581d7f6781e"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:57:42.417273 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-d64a9c82-ea33-40e0-8fe0-7caf2febd189 req-ec24aa6e-3dfb-438e-a252-3e64a8898132 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:42.417797 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-d64a9c82-ea33-40e0-8fe0-7caf2febd189 req-ec24aa6e-3dfb-438e-a252-3e64a8898132 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:42.418228 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-d64a9c82-ea33-40e0-8fe0-7caf2febd189 req-ec24aa6e-3dfb-438e-a252-3e64a8898132 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:42.429171 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-d64a9c82-ea33-40e0-8fe0-7caf2febd189 req-ec24aa6e-3dfb-438e-a252-3e64a8898132 service nova] Creating event network-vif-deleted:d77fbe69-b931-4dfb-ac17-d581d7f6781e for instance 2842e80e-fd61-48cf-b415-c5513f6811df on hv-cinder-79053 Sep 16 09:57:42.434273 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-d64a9c82-ea33-40e0-8fe0-7caf2febd189 req-ec24aa6e-3dfb-438e-a252-3e64a8898132 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029978 Sep 16 09:57:42.435051 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 473/947] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:57:42.614671 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-f24279a8-9748-4172-a8d2-eea7c332f6b1 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:42.615295 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-f24279a8-9748-4172-a8d2-eea7c332f6b1 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] [instance: a74942a9-2ed1-4058-b2f6-6def2204784a] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:42.622696 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f24279a8-9748-4172-a8d2-eea7c332f6b1 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:42.623184 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f24279a8-9748-4172-a8d2-eea7c332f6b1 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:42.623633 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f24279a8-9748-4172-a8d2-eea7c332f6b1 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:42.624328 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f24279a8-9748-4172-a8d2-eea7c332f6b1 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:42.624788 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f24279a8-9748-4172-a8d2-eea7c332f6b1 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:42.625219 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f24279a8-9748-4172-a8d2-eea7c332f6b1 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:42.639519 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.wsgi [None req-f24279a8-9748-4172-a8d2-eea7c332f6b1 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] HTTP exception thrown: Instance a74942a9-2ed1-4058-b2f6-6def2204784a could not be found. Sep 16 09:57:42.641177 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-f24279a8-9748-4172-a8d2-eea7c332f6b1 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Request method failure captured: Sep 16 09:57:42.641177 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: request: GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a HTTP/1.1 Sep 16 09:57:42.641177 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept: application/json Sep 16 09:57:42.641177 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept-Encoding: identity Sep 16 09:57:42.641177 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Connection: close Sep 16 09:57:42.641177 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Length: 0 Sep 16 09:57:42.641177 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Type: application/json Sep 16 09:57:42.641177 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Host: 10.222.0.73 Sep 16 09:57:42.641177 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Openstack-System-Scope: None Sep 16 09:57:42.641177 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: User-Agent: python-urllib3/1.26.12 Sep 16 09:57:42.641177 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Auth-Token: gAAAAABjJEfoc55Qm5_blEXMBoZlSL5HRSDtCw8cVEn0ba98s-fKdo6_7RDqbUFrNvob6AGetNFO_j2ALx_QHZGFy_TCAay-DkBdrapLavm2Uk2eVvihXC78rZGjF-IO2HzKoWqPWbchlxaPELN4pd_bj46KDJbNGuGR1nmBN-3nDT8gxzsXGf4 Sep 16 09:57:42.641177 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Id: None Sep 16 09:57:42.641177 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Name: None Sep 16 09:57:42.641177 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Identity-Status: Confirmed Sep 16 09:57:42.641177 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Is-Admin-Project: True Sep 16 09:57:42.641177 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Id: default Sep 16 09:57:42.641177 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Name: Default Sep 16 09:57:42.641177 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Id: c3ebe25211ee4dcb887de8e0c9a03040 Sep 16 09:57:42.641177 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Name: tempest-TestMinimumBasicScenario-13493145 Sep 16 09:57:42.641177 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Role: reader,member Sep 16 09:57:42.641177 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Roles: reader,member Sep 16 09:57:42.642858 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c3ebe25211ee4dcb887de8e0c9a03040"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_c3ebe25211ee4dcb887de8e0c9a03040", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c3ebe25211ee4dcb887de8e0c9a03040"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/c3ebe25211ee4dcb887de8e0c9a03040"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 09:57:42.642858 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant: tempest-TestMinimumBasicScenario-13493145 Sep 16 09:57:42.642858 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Id: c3ebe25211ee4dcb887de8e0c9a03040 Sep 16 09:57:42.642858 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Name: tempest-TestMinimumBasicScenario-13493145 Sep 16 09:57:42.642858 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User: tempest-TestMinimumBasicScenario-13493145-project Sep 16 09:57:42.642858 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Id: default Sep 16 09:57:42.642858 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Name: Default Sep 16 09:57:42.642858 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Id: b850cd7b216d4aab865886d20194f322 Sep 16 09:57:42.642858 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Name: tempest-TestMinimumBasicScenario-13493145-project Sep 16 09:57:42.642858 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: method: > Sep 16 09:57:42.642858 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: exception: Instance a74942a9-2ed1-4058-b2f6-6def2204784a could not be found. Sep 16 09:57:42.642858 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: action_args: {'id': 'a74942a9-2ed1-4058-b2f6-6def2204784a'} Sep 16 09:57:42.643774 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 09:57:42.643774 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:57:42.643774 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 09:57:42.643774 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 09:57:42.643774 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 09:57:42.643774 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 09:57:42.643774 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 09:57:42.643774 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 09:57:42.643774 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 09:57:42.643774 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 09:57:42.643774 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a74942a9-2ed1-4058-b2f6-6def2204784a could not be found. Sep 16 09:57:42.643774 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:57:42.643774 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:57:42.643774 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:57:42.643774 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:57:42.643774 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:57:42.643774 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:57:42.643774 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 09:57:42.643774 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 09:57:42.643774 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 09:57:42.645264 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:57:42.645264 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 09:57:42.645264 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 09:57:42.645264 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 09:57:42.645264 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 09:57:42.645264 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 09:57:42.645264 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 09:57:42.645264 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a74942a9-2ed1-4058-b2f6-6def2204784a could not be found. Sep 16 09:57:42.645264 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:57:42.645264 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:57:42.645264 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:57:42.645264 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:57:42.645264 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:57:42.645264 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:57:42.645264 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 09:57:42.645264 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 09:57:42.645264 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a74942a9-2ed1-4058-b2f6-6def2204784a could not be found. Sep 16 09:57:42.645264 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:57:42.646715 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-f24279a8-9748-4172-a8d2-eea7c332f6b1 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Returning 404 to user: Instance a74942a9-2ed1-4058-b2f6-6def2204784a could not be found. {{(pid=127671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 09:57:42.646715 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-f24279a8-9748-4172-a8d2-eea7c332f6b1 tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a" status: 404 len: 111 microversion: 2.1 time: 0.032274 Sep 16 09:57:42.646715 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 475/948] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:57:42 2022] GET /compute/v2.1/servers/a74942a9-2ed1-4058-b2f6-6def2204784a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 09:57:42.652129 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-115ddf09-5bf2-4813-9260-f0aa273f259a tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] Calling method '.version_select at 0x7ffa6dd04e50>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:42.721812 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-115ddf09-5bf2-4813-9260-f0aa273f259a tempest-TestMinimumBasicScenario-13493145 tempest-TestMinimumBasicScenario-13493145-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-432505954" status: 202 len: 0 microversion: 2.1 time: 0.073863 Sep 16 09:57:42.722395 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 474/949] 10.222.0.73 () {58 vars in 1269 bytes} [Fri Sep 16 09:57:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-432505954 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 09:57:42.735296 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-c4c9f891-caf9-47a2-9d8f-f5b075f02247 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:42.735911 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-c4c9f891-caf9-47a2-9d8f-f5b075f02247 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 2842e80e-fd61-48cf-b415-c5513f6811df] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:42.742646 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c4c9f891-caf9-47a2-9d8f-f5b075f02247 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:42.743095 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c4c9f891-caf9-47a2-9d8f-f5b075f02247 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:42.743532 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c4c9f891-caf9-47a2-9d8f-f5b075f02247 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:42.744226 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c4c9f891-caf9-47a2-9d8f-f5b075f02247 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:42.744680 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c4c9f891-caf9-47a2-9d8f-f5b075f02247 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:42.745114 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c4c9f891-caf9-47a2-9d8f-f5b075f02247 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:42.758933 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.wsgi [None req-c4c9f891-caf9-47a2-9d8f-f5b075f02247 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] HTTP exception thrown: Instance 2842e80e-fd61-48cf-b415-c5513f6811df could not be found. Sep 16 09:57:42.760440 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-c4c9f891-caf9-47a2-9d8f-f5b075f02247 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Request method failure captured: Sep 16 09:57:42.760440 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: request: GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df HTTP/1.1 Sep 16 09:57:42.760440 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept: application/json Sep 16 09:57:42.760440 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept-Encoding: identity Sep 16 09:57:42.760440 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Connection: close Sep 16 09:57:42.760440 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Length: 0 Sep 16 09:57:42.760440 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Type: application/json Sep 16 09:57:42.760440 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Host: 10.222.0.73 Sep 16 09:57:42.760440 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Openstack-System-Scope: None Sep 16 09:57:42.760440 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: User-Agent: python-urllib3/1.26.12 Sep 16 09:57:42.760440 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Auth-Token: gAAAAABjJEbyIogtO-fgeLO9uv3_XXDwxtVD1eIMLN7x0Q3ZD4pj8hYAM6nbLEwKtYbBaube26iELy7B5lx0xTiRTzRgXZs50v25I7qfb15XuH_i9MG8_BlVJAG6OZoKZu6GI9c8evKltkWyTv3vVrhFavNaXN0ju9i-ZnFY6eOsWcD7CFugHvs Sep 16 09:57:42.760440 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Id: None Sep 16 09:57:42.760440 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Name: None Sep 16 09:57:42.760440 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Identity-Status: Confirmed Sep 16 09:57:42.760440 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Is-Admin-Project: True Sep 16 09:57:42.760440 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Id: default Sep 16 09:57:42.760440 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Name: Default Sep 16 09:57:42.760440 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Id: 75007587f92646f686881c2e1bfb7b2d Sep 16 09:57:42.760440 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Name: tempest-AttachVolumeNegativeTest-1478592665 Sep 16 09:57:42.760440 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Role: reader,member Sep 16 09:57:42.760440 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Roles: reader,member Sep 16 09:57:42.762025 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/75007587f92646f686881c2e1bfb7b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_75007587f92646f686881c2e1bfb7b2d", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/75007587f92646f686881c2e1bfb7b2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/75007587f92646f686881c2e1bfb7b2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 09:57:42.762025 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant: tempest-AttachVolumeNegativeTest-1478592665 Sep 16 09:57:42.762025 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Id: 75007587f92646f686881c2e1bfb7b2d Sep 16 09:57:42.762025 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1478592665 Sep 16 09:57:42.762025 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User: tempest-AttachVolumeNegativeTest-1478592665-project Sep 16 09:57:42.762025 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Id: default Sep 16 09:57:42.762025 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Name: Default Sep 16 09:57:42.762025 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Id: 7dca5726e89343828e25def6e6c274bb Sep 16 09:57:42.762025 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Name: tempest-AttachVolumeNegativeTest-1478592665-project Sep 16 09:57:42.762025 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: method: > Sep 16 09:57:42.762025 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: exception: Instance 2842e80e-fd61-48cf-b415-c5513f6811df could not be found. Sep 16 09:57:42.762025 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: action_args: {'id': '2842e80e-fd61-48cf-b415-c5513f6811df'} Sep 16 09:57:42.766344 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 09:57:42.766344 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:57:42.766344 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 09:57:42.766344 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 09:57:42.766344 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 09:57:42.766344 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 09:57:42.766344 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 09:57:42.766344 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 09:57:42.766344 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 09:57:42.766344 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 09:57:42.766344 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2842e80e-fd61-48cf-b415-c5513f6811df could not be found. Sep 16 09:57:42.766344 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:57:42.766344 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:57:42.766344 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:57:42.766344 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:57:42.766344 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:57:42.766344 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:57:42.766344 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 09:57:42.766344 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 09:57:42.766344 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 09:57:42.767811 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:57:42.767811 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 09:57:42.767811 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 09:57:42.767811 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 09:57:42.767811 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 09:57:42.767811 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 09:57:42.767811 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 09:57:42.767811 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2842e80e-fd61-48cf-b415-c5513f6811df could not be found. Sep 16 09:57:42.767811 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:57:42.767811 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:57:42.767811 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:57:42.767811 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:57:42.767811 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:57:42.767811 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:57:42.767811 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 09:57:42.767811 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 09:57:42.767811 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2842e80e-fd61-48cf-b415-c5513f6811df could not be found. Sep 16 09:57:42.767811 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:57:42.769104 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-c4c9f891-caf9-47a2-9d8f-f5b075f02247 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Returning 404 to user: Instance 2842e80e-fd61-48cf-b415-c5513f6811df could not be found. {{(pid=127671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 09:57:42.769104 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-c4c9f891-caf9-47a2-9d8f-f5b075f02247 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df" status: 404 len: 111 microversion: 2.1 time: 0.030764 Sep 16 09:57:42.769104 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 476/950] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:57:42 2022] GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 09:57:42.771521 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-3ffb34ad-7fec-41b4-99a1-29b70726d585 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '.version_select at 0x7ffa71324a60>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:42.906708 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-3ffb34ad-7fec-41b4-99a1-29b70726d585 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-528630339" status: 202 len: 0 microversion: 2.1 time: 0.139570 Sep 16 09:57:42.907440 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 475/951] 10.222.0.73 () {58 vars in 1218 bytes} [Fri Sep 16 09:57:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-528630339 => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 09:57:45.074859 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-e5688239-fcc8-4e68-ba16-e5486c854586 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:45.075367 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-e5688239-fcc8-4e68-ba16-e5486c854586 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 2842e80e-fd61-48cf-b415-c5513f6811df] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:45.081927 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e5688239-fcc8-4e68-ba16-e5486c854586 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:45.082419 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e5688239-fcc8-4e68-ba16-e5486c854586 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:45.082860 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e5688239-fcc8-4e68-ba16-e5486c854586 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:45.083551 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e5688239-fcc8-4e68-ba16-e5486c854586 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:45.084019 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e5688239-fcc8-4e68-ba16-e5486c854586 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:45.084601 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e5688239-fcc8-4e68-ba16-e5486c854586 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:45.098742 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.wsgi [None req-e5688239-fcc8-4e68-ba16-e5486c854586 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] HTTP exception thrown: Instance 2842e80e-fd61-48cf-b415-c5513f6811df could not be found. Sep 16 09:57:45.100290 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-e5688239-fcc8-4e68-ba16-e5486c854586 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Request method failure captured: Sep 16 09:57:45.100290 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: request: DELETE /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df HTTP/1.1 Sep 16 09:57:45.100290 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept: application/json Sep 16 09:57:45.100290 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept-Encoding: identity Sep 16 09:57:45.100290 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Connection: close Sep 16 09:57:45.100290 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Length: 0 Sep 16 09:57:45.100290 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Type: application/json Sep 16 09:57:45.100290 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Host: 10.222.0.73 Sep 16 09:57:45.100290 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Openstack-System-Scope: None Sep 16 09:57:45.100290 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: User-Agent: python-urllib3/1.26.12 Sep 16 09:57:45.100290 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Auth-Token: gAAAAABjJEbyIogtO-fgeLO9uv3_XXDwxtVD1eIMLN7x0Q3ZD4pj8hYAM6nbLEwKtYbBaube26iELy7B5lx0xTiRTzRgXZs50v25I7qfb15XuH_i9MG8_BlVJAG6OZoKZu6GI9c8evKltkWyTv3vVrhFavNaXN0ju9i-ZnFY6eOsWcD7CFugHvs Sep 16 09:57:45.100290 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Id: None Sep 16 09:57:45.100290 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Name: None Sep 16 09:57:45.100290 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Identity-Status: Confirmed Sep 16 09:57:45.100290 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Is-Admin-Project: True Sep 16 09:57:45.100290 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Id: default Sep 16 09:57:45.100290 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Name: Default Sep 16 09:57:45.100290 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Id: 75007587f92646f686881c2e1bfb7b2d Sep 16 09:57:45.100290 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Name: tempest-AttachVolumeNegativeTest-1478592665 Sep 16 09:57:45.100290 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Role: reader,member Sep 16 09:57:45.100290 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Roles: reader,member Sep 16 09:57:45.102514 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/75007587f92646f686881c2e1bfb7b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_75007587f92646f686881c2e1bfb7b2d", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/75007587f92646f686881c2e1bfb7b2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/75007587f92646f686881c2e1bfb7b2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 09:57:45.102514 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant: tempest-AttachVolumeNegativeTest-1478592665 Sep 16 09:57:45.102514 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Id: 75007587f92646f686881c2e1bfb7b2d Sep 16 09:57:45.102514 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1478592665 Sep 16 09:57:45.102514 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User: tempest-AttachVolumeNegativeTest-1478592665-project Sep 16 09:57:45.102514 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Id: default Sep 16 09:57:45.102514 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Name: Default Sep 16 09:57:45.102514 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Id: 7dca5726e89343828e25def6e6c274bb Sep 16 09:57:45.102514 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Name: tempest-AttachVolumeNegativeTest-1478592665-project Sep 16 09:57:45.102514 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: method: > Sep 16 09:57:45.102514 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: exception: Instance 2842e80e-fd61-48cf-b415-c5513f6811df could not be found. Sep 16 09:57:45.102514 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: action_args: {'id': '2842e80e-fd61-48cf-b415-c5513f6811df'} Sep 16 09:57:45.103421 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 09:57:45.103421 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:57:45.103421 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 09:57:45.103421 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 09:57:45.103421 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 09:57:45.103421 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 09:57:45.103421 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 09:57:45.103421 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 09:57:45.103421 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 09:57:45.103421 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 09:57:45.103421 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2842e80e-fd61-48cf-b415-c5513f6811df could not be found. Sep 16 09:57:45.103421 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:57:45.103421 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:57:45.103421 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:57:45.103421 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:57:45.103421 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:57:45.103421 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:57:45.103421 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 09:57:45.103421 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 09:57:45.103421 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 09:57:45.104904 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:57:45.104904 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 09:57:45.104904 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 09:57:45.104904 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 09:57:45.104904 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 09:57:45.104904 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 09:57:45.104904 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 09:57:45.104904 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 09:57:45.104904 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 09:57:45.104904 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2842e80e-fd61-48cf-b415-c5513f6811df could not be found. Sep 16 09:57:45.104904 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:57:45.104904 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:57:45.104904 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:57:45.104904 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:57:45.104904 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:57:45.104904 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:57:45.104904 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 09:57:45.104904 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 09:57:45.104904 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2842e80e-fd61-48cf-b415-c5513f6811df could not be found. Sep 16 09:57:45.104904 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:57:45.106460 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-e5688239-fcc8-4e68-ba16-e5486c854586 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Returning 404 to user: Instance 2842e80e-fd61-48cf-b415-c5513f6811df could not be found. {{(pid=127671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 09:57:45.106460 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-e5688239-fcc8-4e68-ba16-e5486c854586 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "DELETE /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df" status: 404 len: 111 microversion: 2.1 time: 0.030802 Sep 16 09:57:45.106460 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 477/952] 10.222.0.73 () {58 vars in 1239 bytes} [Fri Sep 16 09:57:45 2022] DELETE /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 09:57:45.111609 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d60e2ed4-fbd7-4723-9273-c1609065b95f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:45.112351 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-d60e2ed4-fbd7-4723-9273-c1609065b95f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 2842e80e-fd61-48cf-b415-c5513f6811df] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:45.118885 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d60e2ed4-fbd7-4723-9273-c1609065b95f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:45.119387 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d60e2ed4-fbd7-4723-9273-c1609065b95f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:45.119831 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d60e2ed4-fbd7-4723-9273-c1609065b95f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:45.120808 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d60e2ed4-fbd7-4723-9273-c1609065b95f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:45.121272 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d60e2ed4-fbd7-4723-9273-c1609065b95f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:45.121742 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d60e2ed4-fbd7-4723-9273-c1609065b95f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:45.137902 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.wsgi [None req-d60e2ed4-fbd7-4723-9273-c1609065b95f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] HTTP exception thrown: Instance 2842e80e-fd61-48cf-b415-c5513f6811df could not be found. Sep 16 09:57:45.139603 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d60e2ed4-fbd7-4723-9273-c1609065b95f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Request method failure captured: Sep 16 09:57:45.139603 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: request: GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df HTTP/1.1 Sep 16 09:57:45.139603 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept: application/json Sep 16 09:57:45.139603 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Sep 16 09:57:45.139603 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Connection: close Sep 16 09:57:45.139603 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Length: 0 Sep 16 09:57:45.139603 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Type: application/json Sep 16 09:57:45.139603 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Host: 10.222.0.73 Sep 16 09:57:45.139603 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Sep 16 09:57:45.139603 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Sep 16 09:57:45.139603 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjJEbyIogtO-fgeLO9uv3_XXDwxtVD1eIMLN7x0Q3ZD4pj8hYAM6nbLEwKtYbBaube26iELy7B5lx0xTiRTzRgXZs50v25I7qfb15XuH_i9MG8_BlVJAG6OZoKZu6GI9c8evKltkWyTv3vVrhFavNaXN0ju9i-ZnFY6eOsWcD7CFugHvs Sep 16 09:57:45.139603 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Sep 16 09:57:45.139603 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Sep 16 09:57:45.139603 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Sep 16 09:57:45.139603 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Sep 16 09:57:45.139603 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Sep 16 09:57:45.139603 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Sep 16 09:57:45.139603 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Id: 75007587f92646f686881c2e1bfb7b2d Sep 16 09:57:45.139603 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-AttachVolumeNegativeTest-1478592665 Sep 16 09:57:45.139603 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Role: reader,member Sep 16 09:57:45.139603 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Roles: reader,member Sep 16 09:57:45.141074 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/75007587f92646f686881c2e1bfb7b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_75007587f92646f686881c2e1bfb7b2d", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/75007587f92646f686881c2e1bfb7b2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/75007587f92646f686881c2e1bfb7b2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 09:57:45.141074 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-AttachVolumeNegativeTest-1478592665 Sep 16 09:57:45.141074 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Id: 75007587f92646f686881c2e1bfb7b2d Sep 16 09:57:45.141074 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1478592665 Sep 16 09:57:45.141074 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User: tempest-AttachVolumeNegativeTest-1478592665-project Sep 16 09:57:45.141074 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Sep 16 09:57:45.141074 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Sep 16 09:57:45.141074 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Id: 7dca5726e89343828e25def6e6c274bb Sep 16 09:57:45.141074 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-AttachVolumeNegativeTest-1478592665-project Sep 16 09:57:45.141074 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: method: > Sep 16 09:57:45.141074 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: exception: Instance 2842e80e-fd61-48cf-b415-c5513f6811df could not be found. Sep 16 09:57:45.141074 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: action_args: {'id': '2842e80e-fd61-48cf-b415-c5513f6811df'} Sep 16 09:57:45.141918 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 09:57:45.141918 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:57:45.141918 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 09:57:45.141918 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 09:57:45.141918 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 09:57:45.141918 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 09:57:45.141918 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 09:57:45.141918 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 09:57:45.141918 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 09:57:45.141918 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 09:57:45.141918 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2842e80e-fd61-48cf-b415-c5513f6811df could not be found. Sep 16 09:57:45.141918 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:57:45.141918 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:57:45.141918 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:57:45.141918 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:57:45.141918 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:57:45.141918 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:57:45.141918 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 09:57:45.141918 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 09:57:45.141918 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 09:57:45.143201 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:57:45.143201 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 09:57:45.143201 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 09:57:45.143201 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 09:57:45.143201 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 09:57:45.143201 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 09:57:45.143201 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 09:57:45.143201 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2842e80e-fd61-48cf-b415-c5513f6811df could not be found. Sep 16 09:57:45.143201 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:57:45.143201 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:57:45.143201 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:57:45.143201 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:57:45.143201 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:57:45.143201 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:57:45.143201 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 09:57:45.143201 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 09:57:45.143201 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2842e80e-fd61-48cf-b415-c5513f6811df could not be found. Sep 16 09:57:45.143201 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:57:45.144286 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d60e2ed4-fbd7-4723-9273-c1609065b95f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Returning 404 to user: Instance 2842e80e-fd61-48cf-b415-c5513f6811df could not be found. {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 09:57:45.144286 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-d60e2ed4-fbd7-4723-9273-c1609065b95f tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df" status: 404 len: 111 microversion: 2.1 time: 0.034179 Sep 16 09:57:45.144286 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 476/953] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:57:45 2022] GET /compute/v2.1/servers/2842e80e-fd61-48cf-b415-c5513f6811df => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 09:57:46.500210 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-d79a77b5-2bac-428a-ad48-f48b32da5b05 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:46.500718 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-d79a77b5-2bac-428a-ad48-f48b32da5b05 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: db7a1d44-25f8-48e4-a8b6-f6ea14a508cb] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:46.507718 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d79a77b5-2bac-428a-ad48-f48b32da5b05 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:46.508208 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d79a77b5-2bac-428a-ad48-f48b32da5b05 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:46.508855 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d79a77b5-2bac-428a-ad48-f48b32da5b05 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:46.509623 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d79a77b5-2bac-428a-ad48-f48b32da5b05 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:46.510052 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d79a77b5-2bac-428a-ad48-f48b32da5b05 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:46.510659 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d79a77b5-2bac-428a-ad48-f48b32da5b05 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:46.536637 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.wsgi [None req-d79a77b5-2bac-428a-ad48-f48b32da5b05 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] HTTP exception thrown: Instance db7a1d44-25f8-48e4-a8b6-f6ea14a508cb could not be found. Sep 16 09:57:46.539112 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-d79a77b5-2bac-428a-ad48-f48b32da5b05 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Request method failure captured: Sep 16 09:57:46.539112 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: request: DELETE /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb HTTP/1.1 Sep 16 09:57:46.539112 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept: application/json Sep 16 09:57:46.539112 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept-Encoding: identity Sep 16 09:57:46.539112 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Connection: close Sep 16 09:57:46.539112 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Length: 0 Sep 16 09:57:46.539112 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Type: application/json Sep 16 09:57:46.539112 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Host: 10.222.0.73 Sep 16 09:57:46.539112 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Openstack-System-Scope: None Sep 16 09:57:46.539112 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: User-Agent: python-urllib3/1.26.12 Sep 16 09:57:46.539112 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Auth-Token: gAAAAABjJEbyIogtO-fgeLO9uv3_XXDwxtVD1eIMLN7x0Q3ZD4pj8hYAM6nbLEwKtYbBaube26iELy7B5lx0xTiRTzRgXZs50v25I7qfb15XuH_i9MG8_BlVJAG6OZoKZu6GI9c8evKltkWyTv3vVrhFavNaXN0ju9i-ZnFY6eOsWcD7CFugHvs Sep 16 09:57:46.539112 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Id: None Sep 16 09:57:46.539112 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Name: None Sep 16 09:57:46.539112 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Identity-Status: Confirmed Sep 16 09:57:46.539112 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Is-Admin-Project: True Sep 16 09:57:46.539112 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Id: default Sep 16 09:57:46.539112 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Name: Default Sep 16 09:57:46.539112 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Id: 75007587f92646f686881c2e1bfb7b2d Sep 16 09:57:46.539112 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Name: tempest-AttachVolumeNegativeTest-1478592665 Sep 16 09:57:46.539112 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Role: reader,member Sep 16 09:57:46.539112 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Roles: reader,member Sep 16 09:57:46.540774 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/75007587f92646f686881c2e1bfb7b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_75007587f92646f686881c2e1bfb7b2d", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/75007587f92646f686881c2e1bfb7b2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/75007587f92646f686881c2e1bfb7b2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 09:57:46.540774 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant: tempest-AttachVolumeNegativeTest-1478592665 Sep 16 09:57:46.540774 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Id: 75007587f92646f686881c2e1bfb7b2d Sep 16 09:57:46.540774 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1478592665 Sep 16 09:57:46.540774 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User: tempest-AttachVolumeNegativeTest-1478592665-project Sep 16 09:57:46.540774 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Id: default Sep 16 09:57:46.540774 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Name: Default Sep 16 09:57:46.540774 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Id: 7dca5726e89343828e25def6e6c274bb Sep 16 09:57:46.540774 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Name: tempest-AttachVolumeNegativeTest-1478592665-project Sep 16 09:57:46.540774 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: method: > Sep 16 09:57:46.540774 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: exception: Instance db7a1d44-25f8-48e4-a8b6-f6ea14a508cb could not be found. Sep 16 09:57:46.540774 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: action_args: {'id': 'db7a1d44-25f8-48e4-a8b6-f6ea14a508cb'} Sep 16 09:57:46.541785 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 09:57:46.541785 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:57:46.541785 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 09:57:46.541785 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 09:57:46.541785 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 09:57:46.541785 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 09:57:46.541785 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 09:57:46.541785 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 09:57:46.541785 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 09:57:46.541785 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 09:57:46.541785 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db7a1d44-25f8-48e4-a8b6-f6ea14a508cb could not be found. Sep 16 09:57:46.541785 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:57:46.541785 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:57:46.541785 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:57:46.541785 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:57:46.541785 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:57:46.541785 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:57:46.541785 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 09:57:46.541785 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 09:57:46.541785 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 09:57:46.543405 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:57:46.543405 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 09:57:46.543405 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 09:57:46.543405 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 09:57:46.543405 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 09:57:46.543405 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 09:57:46.543405 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 09:57:46.543405 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 09:57:46.543405 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 09:57:46.543405 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db7a1d44-25f8-48e4-a8b6-f6ea14a508cb could not be found. Sep 16 09:57:46.543405 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:57:46.543405 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:57:46.543405 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:57:46.543405 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:57:46.543405 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:57:46.543405 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:57:46.543405 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 09:57:46.543405 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 09:57:46.543405 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db7a1d44-25f8-48e4-a8b6-f6ea14a508cb could not be found. Sep 16 09:57:46.543405 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:57:46.544889 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-d79a77b5-2bac-428a-ad48-f48b32da5b05 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Returning 404 to user: Instance db7a1d44-25f8-48e4-a8b6-f6ea14a508cb could not be found. {{(pid=127671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 09:57:46.544889 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-d79a77b5-2bac-428a-ad48-f48b32da5b05 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "DELETE /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb" status: 404 len: 111 microversion: 2.1 time: 0.044222 Sep 16 09:57:46.544889 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 478/954] 10.222.0.73 () {58 vars in 1239 bytes} [Fri Sep 16 09:57:46 2022] DELETE /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 09:57:46.549039 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-5a635229-4e99-499e-a296-517fba36975d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:46.549701 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-5a635229-4e99-499e-a296-517fba36975d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: db7a1d44-25f8-48e4-a8b6-f6ea14a508cb] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:46.556946 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5a635229-4e99-499e-a296-517fba36975d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:46.557447 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5a635229-4e99-499e-a296-517fba36975d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:46.557935 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5a635229-4e99-499e-a296-517fba36975d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:46.558647 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5a635229-4e99-499e-a296-517fba36975d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:46.559114 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5a635229-4e99-499e-a296-517fba36975d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:46.559545 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5a635229-4e99-499e-a296-517fba36975d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:46.573891 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.wsgi [None req-5a635229-4e99-499e-a296-517fba36975d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] HTTP exception thrown: Instance db7a1d44-25f8-48e4-a8b6-f6ea14a508cb could not be found. Sep 16 09:57:46.575445 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-5a635229-4e99-499e-a296-517fba36975d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Request method failure captured: Sep 16 09:57:46.575445 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: request: GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb HTTP/1.1 Sep 16 09:57:46.575445 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept: application/json Sep 16 09:57:46.575445 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Sep 16 09:57:46.575445 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Connection: close Sep 16 09:57:46.575445 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Length: 0 Sep 16 09:57:46.575445 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Type: application/json Sep 16 09:57:46.575445 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Host: 10.222.0.73 Sep 16 09:57:46.575445 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Sep 16 09:57:46.575445 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Sep 16 09:57:46.575445 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjJEbyIogtO-fgeLO9uv3_XXDwxtVD1eIMLN7x0Q3ZD4pj8hYAM6nbLEwKtYbBaube26iELy7B5lx0xTiRTzRgXZs50v25I7qfb15XuH_i9MG8_BlVJAG6OZoKZu6GI9c8evKltkWyTv3vVrhFavNaXN0ju9i-ZnFY6eOsWcD7CFugHvs Sep 16 09:57:46.575445 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Sep 16 09:57:46.575445 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Sep 16 09:57:46.575445 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Sep 16 09:57:46.575445 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Sep 16 09:57:46.575445 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Sep 16 09:57:46.575445 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Sep 16 09:57:46.575445 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Id: 75007587f92646f686881c2e1bfb7b2d Sep 16 09:57:46.575445 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-AttachVolumeNegativeTest-1478592665 Sep 16 09:57:46.575445 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Role: reader,member Sep 16 09:57:46.575445 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Roles: reader,member Sep 16 09:57:46.577083 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/75007587f92646f686881c2e1bfb7b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_75007587f92646f686881c2e1bfb7b2d", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/75007587f92646f686881c2e1bfb7b2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/75007587f92646f686881c2e1bfb7b2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 09:57:46.577083 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-AttachVolumeNegativeTest-1478592665 Sep 16 09:57:46.577083 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Id: 75007587f92646f686881c2e1bfb7b2d Sep 16 09:57:46.577083 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1478592665 Sep 16 09:57:46.577083 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User: tempest-AttachVolumeNegativeTest-1478592665-project Sep 16 09:57:46.577083 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Sep 16 09:57:46.577083 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Sep 16 09:57:46.577083 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Id: 7dca5726e89343828e25def6e6c274bb Sep 16 09:57:46.577083 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-AttachVolumeNegativeTest-1478592665-project Sep 16 09:57:46.577083 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: method: > Sep 16 09:57:46.577083 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: exception: Instance db7a1d44-25f8-48e4-a8b6-f6ea14a508cb could not be found. Sep 16 09:57:46.577083 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: action_args: {'id': 'db7a1d44-25f8-48e4-a8b6-f6ea14a508cb'} Sep 16 09:57:46.578028 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 09:57:46.578028 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:57:46.578028 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 09:57:46.578028 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 09:57:46.578028 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 09:57:46.578028 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 09:57:46.578028 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 09:57:46.578028 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 09:57:46.578028 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 09:57:46.578028 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 09:57:46.578028 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db7a1d44-25f8-48e4-a8b6-f6ea14a508cb could not be found. Sep 16 09:57:46.578028 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:57:46.578028 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:57:46.578028 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:57:46.578028 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:57:46.578028 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:57:46.578028 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:57:46.578028 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 09:57:46.578028 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 09:57:46.578028 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 09:57:46.579383 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:57:46.579383 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 09:57:46.579383 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 09:57:46.579383 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 09:57:46.579383 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 09:57:46.579383 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 09:57:46.579383 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 09:57:46.579383 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db7a1d44-25f8-48e4-a8b6-f6ea14a508cb could not be found. Sep 16 09:57:46.579383 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:57:46.579383 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:57:46.579383 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:57:46.579383 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:57:46.579383 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:57:46.579383 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:57:46.579383 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 09:57:46.579383 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 09:57:46.579383 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db7a1d44-25f8-48e4-a8b6-f6ea14a508cb could not be found. Sep 16 09:57:46.579383 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:57:46.581268 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-5a635229-4e99-499e-a296-517fba36975d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Returning 404 to user: Instance db7a1d44-25f8-48e4-a8b6-f6ea14a508cb could not be found. {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 09:57:46.582152 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-5a635229-4e99-499e-a296-517fba36975d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb" status: 404 len: 111 microversion: 2.1 time: 0.036972 Sep 16 09:57:46.585736 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 477/955] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:57:46 2022] GET /compute/v2.1/servers/db7a1d44-25f8-48e4-a8b6-f6ea14a508cb => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 09:57:46.590893 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-c6eec41f-035a-424f-a2fe-d3a42d337bb7 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:46.591401 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-c6eec41f-035a-424f-a2fe-d3a42d337bb7 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 33e0e447-38a7-474d-ae32-1941ee3260c6] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:46.597411 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c6eec41f-035a-424f-a2fe-d3a42d337bb7 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:46.597942 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c6eec41f-035a-424f-a2fe-d3a42d337bb7 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:46.598387 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c6eec41f-035a-424f-a2fe-d3a42d337bb7 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:46.599097 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c6eec41f-035a-424f-a2fe-d3a42d337bb7 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:46.599565 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c6eec41f-035a-424f-a2fe-d3a42d337bb7 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:46.600547 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c6eec41f-035a-424f-a2fe-d3a42d337bb7 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:46.614949 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.wsgi [None req-c6eec41f-035a-424f-a2fe-d3a42d337bb7 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] HTTP exception thrown: Instance 33e0e447-38a7-474d-ae32-1941ee3260c6 could not be found. Sep 16 09:57:46.617421 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-c6eec41f-035a-424f-a2fe-d3a42d337bb7 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Request method failure captured: Sep 16 09:57:46.617421 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: request: DELETE /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6 HTTP/1.1 Sep 16 09:57:46.617421 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept: application/json Sep 16 09:57:46.617421 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept-Encoding: identity Sep 16 09:57:46.617421 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Connection: close Sep 16 09:57:46.617421 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Length: 0 Sep 16 09:57:46.617421 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Type: application/json Sep 16 09:57:46.617421 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Host: 10.222.0.73 Sep 16 09:57:46.617421 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Openstack-System-Scope: None Sep 16 09:57:46.617421 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: User-Agent: python-urllib3/1.26.12 Sep 16 09:57:46.617421 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Auth-Token: gAAAAABjJEbyIogtO-fgeLO9uv3_XXDwxtVD1eIMLN7x0Q3ZD4pj8hYAM6nbLEwKtYbBaube26iELy7B5lx0xTiRTzRgXZs50v25I7qfb15XuH_i9MG8_BlVJAG6OZoKZu6GI9c8evKltkWyTv3vVrhFavNaXN0ju9i-ZnFY6eOsWcD7CFugHvs Sep 16 09:57:46.617421 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Id: None Sep 16 09:57:46.617421 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Name: None Sep 16 09:57:46.617421 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Identity-Status: Confirmed Sep 16 09:57:46.617421 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Is-Admin-Project: True Sep 16 09:57:46.617421 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Id: default Sep 16 09:57:46.617421 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Name: Default Sep 16 09:57:46.617421 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Id: 75007587f92646f686881c2e1bfb7b2d Sep 16 09:57:46.617421 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Name: tempest-AttachVolumeNegativeTest-1478592665 Sep 16 09:57:46.617421 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Role: reader,member Sep 16 09:57:46.617421 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Roles: reader,member Sep 16 09:57:46.619110 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/75007587f92646f686881c2e1bfb7b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_75007587f92646f686881c2e1bfb7b2d", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/75007587f92646f686881c2e1bfb7b2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/75007587f92646f686881c2e1bfb7b2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 09:57:46.619110 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant: tempest-AttachVolumeNegativeTest-1478592665 Sep 16 09:57:46.619110 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Id: 75007587f92646f686881c2e1bfb7b2d Sep 16 09:57:46.619110 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1478592665 Sep 16 09:57:46.619110 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User: tempest-AttachVolumeNegativeTest-1478592665-project Sep 16 09:57:46.619110 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Id: default Sep 16 09:57:46.619110 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Name: Default Sep 16 09:57:46.619110 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Id: 7dca5726e89343828e25def6e6c274bb Sep 16 09:57:46.619110 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Name: tempest-AttachVolumeNegativeTest-1478592665-project Sep 16 09:57:46.619110 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: method: > Sep 16 09:57:46.619110 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: exception: Instance 33e0e447-38a7-474d-ae32-1941ee3260c6 could not be found. Sep 16 09:57:46.619110 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: action_args: {'id': '33e0e447-38a7-474d-ae32-1941ee3260c6'} Sep 16 09:57:46.619976 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 09:57:46.619976 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:57:46.619976 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 09:57:46.619976 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 09:57:46.619976 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 09:57:46.619976 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 09:57:46.619976 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 09:57:46.619976 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 09:57:46.619976 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 09:57:46.619976 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 09:57:46.619976 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33e0e447-38a7-474d-ae32-1941ee3260c6 could not be found. Sep 16 09:57:46.619976 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:57:46.619976 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:57:46.619976 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:57:46.619976 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:57:46.619976 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:57:46.619976 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:57:46.619976 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 09:57:46.619976 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 09:57:46.619976 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 09:57:46.621743 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:57:46.621743 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 09:57:46.621743 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 09:57:46.621743 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 09:57:46.621743 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 09:57:46.621743 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 09:57:46.621743 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 09:57:46.621743 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 09:57:46.621743 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 09:57:46.621743 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33e0e447-38a7-474d-ae32-1941ee3260c6 could not be found. Sep 16 09:57:46.621743 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:57:46.621743 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:57:46.621743 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:57:46.621743 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:57:46.621743 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:57:46.621743 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:57:46.621743 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 09:57:46.621743 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 09:57:46.621743 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33e0e447-38a7-474d-ae32-1941ee3260c6 could not be found. Sep 16 09:57:46.621743 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:57:46.623136 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-c6eec41f-035a-424f-a2fe-d3a42d337bb7 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Returning 404 to user: Instance 33e0e447-38a7-474d-ae32-1941ee3260c6 could not be found. {{(pid=127671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 09:57:46.623136 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-c6eec41f-035a-424f-a2fe-d3a42d337bb7 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "DELETE /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6" status: 404 len: 111 microversion: 2.1 time: 0.031856 Sep 16 09:57:46.623136 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 479/956] 10.222.0.73 () {58 vars in 1239 bytes} [Fri Sep 16 09:57:46 2022] DELETE /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 09:57:46.627597 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-9e5c6829-a9e9-422e-8f1f-6d2030d56338 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:46.628225 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-9e5c6829-a9e9-422e-8f1f-6d2030d56338 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: 33e0e447-38a7-474d-ae32-1941ee3260c6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:46.634968 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9e5c6829-a9e9-422e-8f1f-6d2030d56338 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:46.635548 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9e5c6829-a9e9-422e-8f1f-6d2030d56338 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:46.636005 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9e5c6829-a9e9-422e-8f1f-6d2030d56338 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:46.636721 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9e5c6829-a9e9-422e-8f1f-6d2030d56338 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:46.637189 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9e5c6829-a9e9-422e-8f1f-6d2030d56338 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:46.637666 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9e5c6829-a9e9-422e-8f1f-6d2030d56338 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:46.652457 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.wsgi [None req-9e5c6829-a9e9-422e-8f1f-6d2030d56338 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] HTTP exception thrown: Instance 33e0e447-38a7-474d-ae32-1941ee3260c6 could not be found. Sep 16 09:57:46.654088 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-9e5c6829-a9e9-422e-8f1f-6d2030d56338 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Request method failure captured: Sep 16 09:57:46.654088 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: request: GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6 HTTP/1.1 Sep 16 09:57:46.654088 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept: application/json Sep 16 09:57:46.654088 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Sep 16 09:57:46.654088 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Connection: close Sep 16 09:57:46.654088 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Length: 0 Sep 16 09:57:46.654088 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Type: application/json Sep 16 09:57:46.654088 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Host: 10.222.0.73 Sep 16 09:57:46.654088 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Sep 16 09:57:46.654088 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Sep 16 09:57:46.654088 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjJEbyIogtO-fgeLO9uv3_XXDwxtVD1eIMLN7x0Q3ZD4pj8hYAM6nbLEwKtYbBaube26iELy7B5lx0xTiRTzRgXZs50v25I7qfb15XuH_i9MG8_BlVJAG6OZoKZu6GI9c8evKltkWyTv3vVrhFavNaXN0ju9i-ZnFY6eOsWcD7CFugHvs Sep 16 09:57:46.654088 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Sep 16 09:57:46.654088 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Sep 16 09:57:46.654088 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Sep 16 09:57:46.654088 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Sep 16 09:57:46.654088 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Sep 16 09:57:46.654088 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Sep 16 09:57:46.654088 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Id: 75007587f92646f686881c2e1bfb7b2d Sep 16 09:57:46.654088 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-AttachVolumeNegativeTest-1478592665 Sep 16 09:57:46.654088 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Role: reader,member Sep 16 09:57:46.654088 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Roles: reader,member Sep 16 09:57:46.655698 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/75007587f92646f686881c2e1bfb7b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_75007587f92646f686881c2e1bfb7b2d", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/75007587f92646f686881c2e1bfb7b2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/75007587f92646f686881c2e1bfb7b2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 09:57:46.655698 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-AttachVolumeNegativeTest-1478592665 Sep 16 09:57:46.655698 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Id: 75007587f92646f686881c2e1bfb7b2d Sep 16 09:57:46.655698 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1478592665 Sep 16 09:57:46.655698 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User: tempest-AttachVolumeNegativeTest-1478592665-project Sep 16 09:57:46.655698 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Sep 16 09:57:46.655698 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Sep 16 09:57:46.655698 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Id: 7dca5726e89343828e25def6e6c274bb Sep 16 09:57:46.655698 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-AttachVolumeNegativeTest-1478592665-project Sep 16 09:57:46.655698 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: method: > Sep 16 09:57:46.655698 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: exception: Instance 33e0e447-38a7-474d-ae32-1941ee3260c6 could not be found. Sep 16 09:57:46.655698 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: action_args: {'id': '33e0e447-38a7-474d-ae32-1941ee3260c6'} Sep 16 09:57:46.656796 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 09:57:46.656796 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:57:46.656796 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 09:57:46.656796 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 09:57:46.656796 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 09:57:46.656796 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 09:57:46.656796 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 09:57:46.656796 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 09:57:46.656796 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 09:57:46.656796 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 09:57:46.656796 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33e0e447-38a7-474d-ae32-1941ee3260c6 could not be found. Sep 16 09:57:46.656796 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:57:46.656796 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:57:46.656796 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:57:46.656796 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:57:46.656796 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:57:46.656796 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:57:46.656796 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 09:57:46.656796 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 09:57:46.656796 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 09:57:46.660735 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:57:46.660735 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 09:57:46.660735 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 09:57:46.660735 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 09:57:46.660735 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 09:57:46.660735 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 09:57:46.660735 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 09:57:46.660735 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33e0e447-38a7-474d-ae32-1941ee3260c6 could not be found. Sep 16 09:57:46.660735 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:57:46.660735 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:57:46.660735 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:57:46.660735 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:57:46.660735 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:57:46.660735 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:57:46.660735 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 09:57:46.660735 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 09:57:46.660735 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33e0e447-38a7-474d-ae32-1941ee3260c6 could not be found. Sep 16 09:57:46.660735 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:57:46.662314 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-9e5c6829-a9e9-422e-8f1f-6d2030d56338 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Returning 404 to user: Instance 33e0e447-38a7-474d-ae32-1941ee3260c6 could not be found. {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 09:57:46.662314 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-9e5c6829-a9e9-422e-8f1f-6d2030d56338 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6" status: 404 len: 111 microversion: 2.1 time: 0.031815 Sep 16 09:57:46.662314 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 478/957] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:57:46 2022] GET /compute/v2.1/servers/33e0e447-38a7-474d-ae32-1941ee3260c6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 09:57:47.982371 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-a5fb1c10-c6bd-44ec-aacc-f394f9cd637d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:47.982922 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-a5fb1c10-c6bd-44ec-aacc-f394f9cd637d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: efec4ecb-65e7-4ca8-a29f-b87bc9ee1915] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:47.989637 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a5fb1c10-c6bd-44ec-aacc-f394f9cd637d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:47.990318 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a5fb1c10-c6bd-44ec-aacc-f394f9cd637d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:47.991373 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a5fb1c10-c6bd-44ec-aacc-f394f9cd637d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:47.992146 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a5fb1c10-c6bd-44ec-aacc-f394f9cd637d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:47.992624 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a5fb1c10-c6bd-44ec-aacc-f394f9cd637d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:47.993099 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a5fb1c10-c6bd-44ec-aacc-f394f9cd637d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:48.006944 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.wsgi [None req-a5fb1c10-c6bd-44ec-aacc-f394f9cd637d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] HTTP exception thrown: Instance efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 could not be found. Sep 16 09:57:48.008493 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-a5fb1c10-c6bd-44ec-aacc-f394f9cd637d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Request method failure captured: Sep 16 09:57:48.008493 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: request: DELETE /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 HTTP/1.1 Sep 16 09:57:48.008493 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept: application/json Sep 16 09:57:48.008493 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept-Encoding: identity Sep 16 09:57:48.008493 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Connection: close Sep 16 09:57:48.008493 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Length: 0 Sep 16 09:57:48.008493 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Type: application/json Sep 16 09:57:48.008493 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Host: 10.222.0.73 Sep 16 09:57:48.008493 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Openstack-System-Scope: None Sep 16 09:57:48.008493 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: User-Agent: python-urllib3/1.26.12 Sep 16 09:57:48.008493 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Auth-Token: gAAAAABjJEbyIogtO-fgeLO9uv3_XXDwxtVD1eIMLN7x0Q3ZD4pj8hYAM6nbLEwKtYbBaube26iELy7B5lx0xTiRTzRgXZs50v25I7qfb15XuH_i9MG8_BlVJAG6OZoKZu6GI9c8evKltkWyTv3vVrhFavNaXN0ju9i-ZnFY6eOsWcD7CFugHvs Sep 16 09:57:48.008493 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Id: None Sep 16 09:57:48.008493 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Name: None Sep 16 09:57:48.008493 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Identity-Status: Confirmed Sep 16 09:57:48.008493 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Is-Admin-Project: True Sep 16 09:57:48.008493 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Id: default Sep 16 09:57:48.008493 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Name: Default Sep 16 09:57:48.008493 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Id: 75007587f92646f686881c2e1bfb7b2d Sep 16 09:57:48.008493 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Name: tempest-AttachVolumeNegativeTest-1478592665 Sep 16 09:57:48.008493 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Role: reader,member Sep 16 09:57:48.008493 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Roles: reader,member Sep 16 09:57:48.010181 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/75007587f92646f686881c2e1bfb7b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_75007587f92646f686881c2e1bfb7b2d", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/75007587f92646f686881c2e1bfb7b2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/75007587f92646f686881c2e1bfb7b2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 09:57:48.010181 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant: tempest-AttachVolumeNegativeTest-1478592665 Sep 16 09:57:48.010181 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Id: 75007587f92646f686881c2e1bfb7b2d Sep 16 09:57:48.010181 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1478592665 Sep 16 09:57:48.010181 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User: tempest-AttachVolumeNegativeTest-1478592665-project Sep 16 09:57:48.010181 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Id: default Sep 16 09:57:48.010181 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Name: Default Sep 16 09:57:48.010181 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Id: 7dca5726e89343828e25def6e6c274bb Sep 16 09:57:48.010181 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Name: tempest-AttachVolumeNegativeTest-1478592665-project Sep 16 09:57:48.010181 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: method: > Sep 16 09:57:48.010181 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: exception: Instance efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 could not be found. Sep 16 09:57:48.010181 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: action_args: {'id': 'efec4ecb-65e7-4ca8-a29f-b87bc9ee1915'} Sep 16 09:57:48.011090 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 09:57:48.011090 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:57:48.011090 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 09:57:48.011090 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 09:57:48.011090 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 09:57:48.011090 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 09:57:48.011090 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 09:57:48.011090 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 09:57:48.011090 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 09:57:48.011090 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 09:57:48.011090 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 could not be found. Sep 16 09:57:48.011090 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:57:48.011090 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:57:48.011090 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:57:48.011090 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:57:48.011090 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:57:48.011090 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:57:48.011090 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 09:57:48.011090 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 09:57:48.011090 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 09:57:48.012436 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:57:48.012436 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 09:57:48.012436 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 09:57:48.012436 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 09:57:48.012436 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 09:57:48.012436 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 09:57:48.012436 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 09:57:48.012436 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 09:57:48.012436 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 09:57:48.012436 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 could not be found. Sep 16 09:57:48.012436 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:57:48.012436 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:57:48.012436 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:57:48.012436 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:57:48.012436 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:57:48.012436 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:57:48.012436 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 09:57:48.012436 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 09:57:48.012436 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 could not be found. Sep 16 09:57:48.012436 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:57:48.014136 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-a5fb1c10-c6bd-44ec-aacc-f394f9cd637d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Returning 404 to user: Instance efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 could not be found. {{(pid=127671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 09:57:48.014136 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-a5fb1c10-c6bd-44ec-aacc-f394f9cd637d tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "DELETE /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915" status: 404 len: 111 microversion: 2.1 time: 0.031312 Sep 16 09:57:48.014136 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 480/958] 10.222.0.73 () {58 vars in 1239 bytes} [Fri Sep 16 09:57:47 2022] DELETE /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 09:57:48.018414 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d24f8d92-e235-4d03-83b8-4162d196eb65 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:48.047110 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-d24f8d92-e235-4d03-83b8-4162d196eb65 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] [instance: efec4ecb-65e7-4ca8-a29f-b87bc9ee1915] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:57:48.047110 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d24f8d92-e235-4d03-83b8-4162d196eb65 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:48.047110 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d24f8d92-e235-4d03-83b8-4162d196eb65 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:48.047110 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d24f8d92-e235-4d03-83b8-4162d196eb65 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:48.048127 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d24f8d92-e235-4d03-83b8-4162d196eb65 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:57:48.048127 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d24f8d92-e235-4d03-83b8-4162d196eb65 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:57:48.048127 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d24f8d92-e235-4d03-83b8-4162d196eb65 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:57:48.048127 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.wsgi [None req-d24f8d92-e235-4d03-83b8-4162d196eb65 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] HTTP exception thrown: Instance efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 could not be found. Sep 16 09:57:48.048465 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d24f8d92-e235-4d03-83b8-4162d196eb65 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Request method failure captured: Sep 16 09:57:48.048465 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: request: GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 HTTP/1.1 Sep 16 09:57:48.048465 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept: application/json Sep 16 09:57:48.048465 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Sep 16 09:57:48.048465 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Connection: close Sep 16 09:57:48.048465 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Length: 0 Sep 16 09:57:48.048465 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Type: application/json Sep 16 09:57:48.048465 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Host: 10.222.0.73 Sep 16 09:57:48.048465 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Sep 16 09:57:48.048465 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Sep 16 09:57:48.048465 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjJEbyIogtO-fgeLO9uv3_XXDwxtVD1eIMLN7x0Q3ZD4pj8hYAM6nbLEwKtYbBaube26iELy7B5lx0xTiRTzRgXZs50v25I7qfb15XuH_i9MG8_BlVJAG6OZoKZu6GI9c8evKltkWyTv3vVrhFavNaXN0ju9i-ZnFY6eOsWcD7CFugHvs Sep 16 09:57:48.048465 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Sep 16 09:57:48.048465 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Sep 16 09:57:48.048465 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Sep 16 09:57:48.048465 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Sep 16 09:57:48.048465 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Sep 16 09:57:48.048465 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Sep 16 09:57:48.048465 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Id: 75007587f92646f686881c2e1bfb7b2d Sep 16 09:57:48.048465 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-AttachVolumeNegativeTest-1478592665 Sep 16 09:57:48.048465 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Role: reader,member Sep 16 09:57:48.048465 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Roles: reader,member Sep 16 09:57:48.050084 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/75007587f92646f686881c2e1bfb7b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_75007587f92646f686881c2e1bfb7b2d", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/75007587f92646f686881c2e1bfb7b2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/75007587f92646f686881c2e1bfb7b2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 09:57:48.050084 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-AttachVolumeNegativeTest-1478592665 Sep 16 09:57:48.050084 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Id: 75007587f92646f686881c2e1bfb7b2d Sep 16 09:57:48.050084 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1478592665 Sep 16 09:57:48.050084 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User: tempest-AttachVolumeNegativeTest-1478592665-project Sep 16 09:57:48.050084 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Sep 16 09:57:48.050084 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Sep 16 09:57:48.050084 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Id: 7dca5726e89343828e25def6e6c274bb Sep 16 09:57:48.050084 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-AttachVolumeNegativeTest-1478592665-project Sep 16 09:57:48.050084 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: method: > Sep 16 09:57:48.050084 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: exception: Instance efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 could not be found. Sep 16 09:57:48.050084 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: action_args: {'id': 'efec4ecb-65e7-4ca8-a29f-b87bc9ee1915'} Sep 16 09:57:48.051378 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 09:57:48.051378 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:57:48.051378 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 09:57:48.051378 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 09:57:48.051378 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 09:57:48.051378 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 09:57:48.051378 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 09:57:48.051378 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 09:57:48.051378 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 09:57:48.051378 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 09:57:48.051378 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 could not be found. Sep 16 09:57:48.051378 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:57:48.051378 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:57:48.051378 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:57:48.051378 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:57:48.051378 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:57:48.051378 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:57:48.051378 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 09:57:48.051378 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 09:57:48.051378 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 09:57:48.052986 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:57:48.052986 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 09:57:48.052986 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 09:57:48.052986 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 09:57:48.052986 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 09:57:48.052986 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 09:57:48.052986 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 09:57:48.052986 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 could not be found. Sep 16 09:57:48.052986 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:57:48.052986 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:57:48.052986 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:57:48.052986 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:57:48.052986 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:57:48.052986 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:57:48.052986 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 09:57:48.052986 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 09:57:48.052986 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 could not be found. Sep 16 09:57:48.052986 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:57:48.055792 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d24f8d92-e235-4d03-83b8-4162d196eb65 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] Returning 404 to user: Instance efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 could not be found. {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 09:57:48.055792 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-d24f8d92-e235-4d03-83b8-4162d196eb65 tempest-AttachVolumeNegativeTest-1478592665 tempest-AttachVolumeNegativeTest-1478592665-project] 10.222.0.73 "GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915" status: 404 len: 111 microversion: 2.1 time: 0.032037 Sep 16 09:57:48.055792 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 479/959] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:57:48 2022] GET /compute/v2.1/servers/efec4ecb-65e7-4ca8-a29f-b87bc9ee1915 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 09:57:54.651598 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-ddbd2048-bcd4-4471-9f6c-4cd0ca66ac48 tempest-VolumesSnapshotsTestJSON-1309084218 tempest-VolumesSnapshotsTestJSON-1309084218-project] Action: 'create', calling method: .version_select at 0x7ffa6dcc3e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-11910923"}} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:57:55.538317 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-ddbd2048-bcd4-4471-9f6c-4cd0ca66ac48 tempest-VolumesSnapshotsTestJSON-1309084218 tempest-VolumesSnapshotsTestJSON-1309084218-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 1.017897 Sep 16 09:57:55.543893 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 481/960] 10.222.0.73 () {60 vars in 1155 bytes} [Fri Sep 16 09:57:54 2022] POST /compute/v2.1/os-volumes => generated 343 bytes in 1020 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 16 09:57:55.551939 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-86f9ed40-6c5c-4789-937a-86a5a7be0b54 tempest-VolumesSnapshotsTestJSON-1309084218 tempest-VolumesSnapshotsTestJSON-1309084218-project] Calling method '.version_select at 0x7ffa6dfe2b80>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:55.612732 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-86f9ed40-6c5c-4789-937a-86a5a7be0b54 tempest-VolumesSnapshotsTestJSON-1309084218 tempest-VolumesSnapshotsTestJSON-1309084218-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/bfebc89a-cb80-4845-8db6-9f3c0151e772" status: 200 len: 343 microversion: 2.1 time: 0.057519 Sep 16 09:57:55.612732 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 480/961] 10.222.0.73 () {58 vars in 1245 bytes} [Fri Sep 16 09:57:55 2022] GET /compute/v2.1/os-volumes/bfebc89a-cb80-4845-8db6-9f3c0151e772 => generated 343 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:57:56.621158 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-5609f6fc-e3b6-42a4-9f4f-5bbf6962f68f tempest-VolumesSnapshotsTestJSON-1309084218 tempest-VolumesSnapshotsTestJSON-1309084218-project] Calling method '.version_select at 0x7ffa6dcb0b80>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:56.667715 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-5609f6fc-e3b6-42a4-9f4f-5bbf6962f68f tempest-VolumesSnapshotsTestJSON-1309084218 tempest-VolumesSnapshotsTestJSON-1309084218-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/bfebc89a-cb80-4845-8db6-9f3c0151e772" status: 200 len: 344 microversion: 2.1 time: 0.051169 Sep 16 09:57:56.668390 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 482/962] 10.222.0.73 () {58 vars in 1245 bytes} [Fri Sep 16 09:57:56 2022] GET /compute/v2.1/os-volumes/bfebc89a-cb80-4845-8db6-9f3c0151e772 => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:57:56.682490 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-34cd33db-0bed-4b30-a66f-26692f23797f tempest-VolumesSnapshotsTestJSON-1309084218 tempest-VolumesSnapshotsTestJSON-1309084218-project] Action: 'create', calling method: .version_select at 0x7ffa6dc52c10>, body: {"snapshot": {"volume_id": "bfebc89a-cb80-4845-8db6-9f3c0151e772", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-371388429"}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:57:57.321860 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-34cd33db-0bed-4b30-a66f-26692f23797f tempest-VolumesSnapshotsTestJSON-1309084218 tempest-VolumesSnapshotsTestJSON-1309084218-project] 10.222.0.73 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.644436 Sep 16 09:57:57.322442 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 481/963] 10.222.0.73 () {60 vars in 1162 bytes} [Fri Sep 16 09:57:56 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:57:57.333615 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-e44828ce-477c-417d-8703-6f52191cf3ce tempest-VolumesSnapshotsTestJSON-1309084218 tempest-VolumesSnapshotsTestJSON-1309084218-project] Calling method '.version_select at 0x7ffa6dcc3820>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:57.370683 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-e44828ce-477c-417d-8703-6f52191cf3ce tempest-VolumesSnapshotsTestJSON-1309084218 tempest-VolumesSnapshotsTestJSON-1309084218-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/f8af9c1d-a024-422e-bfec-fed06463dd07" status: 200 len: 286 microversion: 2.1 time: 0.040820 Sep 16 09:57:57.374931 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 483/964] 10.222.0.73 () {58 vars in 1251 bytes} [Fri Sep 16 09:57:57 2022] GET /compute/v2.1/os-snapshots/f8af9c1d-a024-422e-bfec-fed06463dd07 => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:57:57.382966 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-c860dbad-131b-40e5-82f2-9a1d35bbc72f tempest-VolumesSnapshotsTestJSON-1309084218 tempest-VolumesSnapshotsTestJSON-1309084218-project] Calling method '.version_select at 0x7ffa713aeaf0>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:57.412938 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-c860dbad-131b-40e5-82f2-9a1d35bbc72f tempest-VolumesSnapshotsTestJSON-1309084218 tempest-VolumesSnapshotsTestJSON-1309084218-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.034683 Sep 16 09:57:57.413501 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 482/965] 10.222.0.73 () {58 vars in 1140 bytes} [Fri Sep 16 09:57:57 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:57:57.424985 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-57984787-6466-4f3c-b94b-de8abf96ef44 tempest-VolumesSnapshotsTestJSON-1309084218 tempest-VolumesSnapshotsTestJSON-1309084218-project] Calling method '.version_select at 0x7ffa6dcc3790>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:57.457046 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-57984787-6466-4f3c-b94b-de8abf96ef44 tempest-VolumesSnapshotsTestJSON-1309084218 tempest-VolumesSnapshotsTestJSON-1309084218-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/f8af9c1d-a024-422e-bfec-fed06463dd07" status: 200 len: 286 microversion: 2.1 time: 0.035832 Sep 16 09:57:57.457852 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 484/966] 10.222.0.73 () {58 vars in 1251 bytes} [Fri Sep 16 09:57:57 2022] GET /compute/v2.1/os-snapshots/f8af9c1d-a024-422e-bfec-fed06463dd07 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 09:57:58.467861 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=2 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:57:58.468622 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=53 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:57:58.472438 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-3248c386-c4c5-46d9-94d6-906cea4c9584 tempest-VolumesSnapshotsTestJSON-1309084218 tempest-VolumesSnapshotsTestJSON-1309084218-project] Calling method '.version_select at 0x7ffa6dc62280>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:58.503593 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-3248c386-c4c5-46d9-94d6-906cea4c9584 tempest-VolumesSnapshotsTestJSON-1309084218 tempest-VolumesSnapshotsTestJSON-1309084218-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/f8af9c1d-a024-422e-bfec-fed06463dd07" status: 200 len: 286 microversion: 2.1 time: 0.036977 Sep 16 09:57:58.508035 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 483/967] 10.222.0.73 () {58 vars in 1251 bytes} [Fri Sep 16 09:57:58 2022] GET /compute/v2.1/os-snapshots/f8af9c1d-a024-422e-bfec-fed06463dd07 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:57:59.513315 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=2 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:57:59.514106 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell1:SELECT=18 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:57:59.517945 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-50fd7b06-e87f-43cb-a59e-34dfa87a909c tempest-VolumesSnapshotsTestJSON-1309084218 tempest-VolumesSnapshotsTestJSON-1309084218-project] Calling method '.version_select at 0x7ffa6dc1f280>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:57:59.547911 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-50fd7b06-e87f-43cb-a59e-34dfa87a909c tempest-VolumesSnapshotsTestJSON-1309084218 tempest-VolumesSnapshotsTestJSON-1309084218-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/f8af9c1d-a024-422e-bfec-fed06463dd07" status: 200 len: 286 microversion: 2.1 time: 0.035651 Sep 16 09:57:59.548469 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 485/968] 10.222.0.73 () {58 vars in 1251 bytes} [Fri Sep 16 09:57:59 2022] GET /compute/v2.1/os-snapshots/f8af9c1d-a024-422e-bfec-fed06463dd07 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:58:00.561816 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-9528e084-0a5e-44ff-b3d2-99d252110d6f tempest-VolumesSnapshotsTestJSON-1309084218 tempest-VolumesSnapshotsTestJSON-1309084218-project] Calling method '.version_select at 0x7ffa6df89dc0>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:58:00.600438 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-9528e084-0a5e-44ff-b3d2-99d252110d6f tempest-VolumesSnapshotsTestJSON-1309084218 tempest-VolumesSnapshotsTestJSON-1309084218-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/f8af9c1d-a024-422e-bfec-fed06463dd07" status: 200 len: 287 microversion: 2.1 time: 0.036023 Sep 16 09:58:00.600438 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 484/969] 10.222.0.73 () {58 vars in 1251 bytes} [Fri Sep 16 09:58:00 2022] GET /compute/v2.1/os-snapshots/f8af9c1d-a024-422e-bfec-fed06463dd07 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:58:00.606128 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-f646861a-d651-45d7-830b-735a78f0e899 tempest-VolumesSnapshotsTestJSON-1309084218 tempest-VolumesSnapshotsTestJSON-1309084218-project] Calling method '.version_select at 0x7ffa6dcc3160>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:58:00.723027 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-f646861a-d651-45d7-830b-735a78f0e899 tempest-VolumesSnapshotsTestJSON-1309084218 tempest-VolumesSnapshotsTestJSON-1309084218-project] 10.222.0.73 "DELETE /compute/v2.1/os-snapshots/f8af9c1d-a024-422e-bfec-fed06463dd07" status: 202 len: 0 microversion: 2.1 time: 0.121542 Sep 16 09:58:00.723636 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 486/970] 10.222.0.73 () {58 vars in 1254 bytes} [Fri Sep 16 09:58:00 2022] DELETE /compute/v2.1/os-snapshots/f8af9c1d-a024-422e-bfec-fed06463dd07 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 09:58:00.732606 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-f3eec534-030e-445a-8e77-fc5d194c8eb4 tempest-VolumesSnapshotsTestJSON-1309084218 tempest-VolumesSnapshotsTestJSON-1309084218-project] Calling method '.version_select at 0x7ffa6de9c940>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:58:00.763492 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-f3eec534-030e-445a-8e77-fc5d194c8eb4 tempest-VolumesSnapshotsTestJSON-1309084218 tempest-VolumesSnapshotsTestJSON-1309084218-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/f8af9c1d-a024-422e-bfec-fed06463dd07" status: 200 len: 286 microversion: 2.1 time: 0.034685 Sep 16 09:58:00.764054 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 485/971] 10.222.0.73 () {58 vars in 1251 bytes} [Fri Sep 16 09:58:00 2022] GET /compute/v2.1/os-snapshots/f8af9c1d-a024-422e-bfec-fed06463dd07 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 09:58:01.777745 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-30669870-6e7a-4a4a-826a-e453a3e547db tempest-VolumesSnapshotsTestJSON-1309084218 tempest-VolumesSnapshotsTestJSON-1309084218-project] Calling method '.version_select at 0x7ffa6dcb0790>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:58:01.807285 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-30669870-6e7a-4a4a-826a-e453a3e547db tempest-VolumesSnapshotsTestJSON-1309084218 tempest-VolumesSnapshotsTestJSON-1309084218-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/f8af9c1d-a024-422e-bfec-fed06463dd07" status: 200 len: 286 microversion: 2.1 time: 0.034699 Sep 16 09:58:01.807868 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 487/972] 10.222.0.73 () {58 vars in 1251 bytes} [Fri Sep 16 09:58:01 2022] GET /compute/v2.1/os-snapshots/f8af9c1d-a024-422e-bfec-fed06463dd07 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:58:02.820085 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-4397eec3-8e48-4e52-b04b-e24fc5ed70c2 tempest-VolumesSnapshotsTestJSON-1309084218 tempest-VolumesSnapshotsTestJSON-1309084218-project] Calling method '.version_select at 0x7ffa6dc52d30>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:58:02.850323 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-4397eec3-8e48-4e52-b04b-e24fc5ed70c2 tempest-VolumesSnapshotsTestJSON-1309084218 tempest-VolumesSnapshotsTestJSON-1309084218-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/f8af9c1d-a024-422e-bfec-fed06463dd07" status: 200 len: 286 microversion: 2.1 time: 0.034722 Sep 16 09:58:02.850875 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 486/973] 10.222.0.73 () {58 vars in 1251 bytes} [Fri Sep 16 09:58:02 2022] GET /compute/v2.1/os-snapshots/f8af9c1d-a024-422e-bfec-fed06463dd07 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 09:58:03.863705 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-87682cfc-0e77-4ef4-8436-e67e6667c641 tempest-VolumesSnapshotsTestJSON-1309084218 tempest-VolumesSnapshotsTestJSON-1309084218-project] Calling method '.version_select at 0x7ffa6dca74c0>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:58:03.890321 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.wsgi [None req-87682cfc-0e77-4ef4-8436-e67e6667c641 tempest-VolumesSnapshotsTestJSON-1309084218 tempest-VolumesSnapshotsTestJSON-1309084218-project] HTTP exception thrown: Snapshot f8af9c1d-a024-422e-bfec-fed06463dd07 could not be found. Sep 16 09:58:03.892517 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-87682cfc-0e77-4ef4-8436-e67e6667c641 tempest-VolumesSnapshotsTestJSON-1309084218 tempest-VolumesSnapshotsTestJSON-1309084218-project] Request method failure captured: Sep 16 09:58:03.892517 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: request: GET /compute/v2.1/os-snapshots/f8af9c1d-a024-422e-bfec-fed06463dd07 HTTP/1.1 Sep 16 09:58:03.892517 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept: application/json Sep 16 09:58:03.892517 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept-Encoding: identity Sep 16 09:58:03.892517 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Connection: close Sep 16 09:58:03.892517 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Length: 0 Sep 16 09:58:03.892517 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Type: application/json Sep 16 09:58:03.892517 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Host: 10.222.0.73 Sep 16 09:58:03.892517 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Openstack-System-Scope: None Sep 16 09:58:03.892517 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: User-Agent: python-urllib3/1.26.12 Sep 16 09:58:03.892517 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Auth-Token: gAAAAABjJEiilu4VOX1B5pUXuOg-hPw4UMSyKDF9J_ZgMlGZhj1AnUhK9xgfaTO7hR5fRtPpqK1FV6cqcGGPb9xvmdRlraaJmn_kN2yZuG4cFAaJucnYi6jfJ_iGoe4s-an1ELc2SmDM8-qObgqrYOYAjRP2iUW9063YNrXIxvVN2r1UAeDgIjg Sep 16 09:58:03.892517 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Id: None Sep 16 09:58:03.892517 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Name: None Sep 16 09:58:03.892517 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Identity-Status: Confirmed Sep 16 09:58:03.892517 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Is-Admin-Project: True Sep 16 09:58:03.892517 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Id: default Sep 16 09:58:03.892517 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Name: Default Sep 16 09:58:03.892517 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Id: 1b8e674aa1f34e38b45512d24df5de25 Sep 16 09:58:03.892517 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1309084218 Sep 16 09:58:03.892517 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Role: reader,member Sep 16 09:58:03.892517 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Roles: reader,member Sep 16 09:58:03.894239 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/1b8e674aa1f34e38b45512d24df5de25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_1b8e674aa1f34e38b45512d24df5de25", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/1b8e674aa1f34e38b45512d24df5de25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/1b8e674aa1f34e38b45512d24df5de25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 09:58:03.894239 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1309084218 Sep 16 09:58:03.894239 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Id: 1b8e674aa1f34e38b45512d24df5de25 Sep 16 09:58:03.894239 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1309084218 Sep 16 09:58:03.894239 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User: tempest-VolumesSnapshotsTestJSON-1309084218-project Sep 16 09:58:03.894239 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Id: default Sep 16 09:58:03.894239 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Name: Default Sep 16 09:58:03.894239 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Id: e1254925b4a3442eac3bfb4f07efa186 Sep 16 09:58:03.894239 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1309084218-project Sep 16 09:58:03.894239 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: method: Sep 16 09:58:03.894239 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: exception: Snapshot f8af9c1d-a024-422e-bfec-fed06463dd07 could not be found. Sep 16 09:58:03.894239 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: action_args: {'id': 'f8af9c1d-a024-422e-bfec-fed06463dd07'} Sep 16 09:58:03.894239 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 09:58:03.895187 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:58:03.895187 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 16 09:58:03.895187 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 16 09:58:03.895187 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 16 09:58:03.895187 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 16 09:58:03.895187 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 16 09:58:03.895187 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 16 09:58:03.895187 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 09:58:03.895187 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 09:58:03.895187 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 09:58:03.895187 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 09:58:03.895187 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 09:58:03.895187 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 09:58:03.895187 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 09:58:03.895187 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 09:58:03.895187 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot f8af9c1d-a024-422e-bfec-fed06463dd07 could not be found. (HTTP 404) (Request-ID: req-6ddafbc4-3bdc-4bbc-8e61-ea44c7240513) Sep 16 09:58:03.895187 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:58:03.895187 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:58:03.896413 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:58:03.896413 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:58:03.896413 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 16 09:58:03.896413 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 16 09:58:03.896413 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 16 09:58:03.896413 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 16 09:58:03.896413 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 16 09:58:03.896413 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 16 09:58:03.896413 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 16 09:58:03.896413 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 16 09:58:03.896413 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 16 09:58:03.896413 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 16 09:58:03.896413 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 16 09:58:03.896413 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 16 09:58:03.896413 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 16 09:58:03.896413 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 16 09:58:03.896413 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 09:58:03.896413 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 09:58:03.896413 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 09:58:03.897707 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 09:58:03.897707 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 09:58:03.897707 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 09:58:03.897707 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 09:58:03.897707 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 09:58:03.897707 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot f8af9c1d-a024-422e-bfec-fed06463dd07 could not be found. Sep 16 09:58:03.897707 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:58:03.897707 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:58:03.897707 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:58:03.897707 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:58:03.897707 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:58:03.897707 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:58:03.897707 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 09:58:03.897707 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 09:58:03.897707 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 09:58:03.897707 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 09:58:03.897707 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 09:58:03.897707 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:58:03.897707 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 16 09:58:03.897707 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 09:58:03.905335 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot f8af9c1d-a024-422e-bfec-fed06463dd07 could not be found. Sep 16 09:58:03.905335 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:58:03.905335 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:58:03.905335 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:58:03.905335 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:58:03.905335 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:58:03.905335 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:58:03.905335 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 09:58:03.905335 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 09:58:03.905335 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot f8af9c1d-a024-422e-bfec-fed06463dd07 could not be found. Sep 16 09:58:03.905335 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:58:03.905335 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-87682cfc-0e77-4ef4-8436-e67e6667c641 tempest-VolumesSnapshotsTestJSON-1309084218 tempest-VolumesSnapshotsTestJSON-1309084218-project] Returning 404 to user: Snapshot f8af9c1d-a024-422e-bfec-fed06463dd07 could not be found. {{(pid=127671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 09:58:03.905335 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-87682cfc-0e77-4ef4-8436-e67e6667c641 tempest-VolumesSnapshotsTestJSON-1309084218 tempest-VolumesSnapshotsTestJSON-1309084218-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/f8af9c1d-a024-422e-bfec-fed06463dd07" status: 404 len: 111 microversion: 2.1 time: 0.034761 Sep 16 09:58:03.906645 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 488/974] 10.222.0.73 () {58 vars in 1251 bytes} [Fri Sep 16 09:58:03 2022] GET /compute/v2.1/os-snapshots/f8af9c1d-a024-422e-bfec-fed06463dd07 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 09:58:03.906748 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-8afebd7a-ee39-4792-b14b-617e956da0a4 tempest-VolumesSnapshotsTestJSON-1309084218 tempest-VolumesSnapshotsTestJSON-1309084218-project] Calling method '.version_select at 0x7ffa6df89dc0>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:58:04.121708 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-8afebd7a-ee39-4792-b14b-617e956da0a4 tempest-VolumesSnapshotsTestJSON-1309084218 tempest-VolumesSnapshotsTestJSON-1309084218-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/bfebc89a-cb80-4845-8db6-9f3c0151e772" status: 202 len: 0 microversion: 2.1 time: 0.222544 Sep 16 09:58:04.122291 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 487/975] 10.222.0.73 () {58 vars in 1248 bytes} [Fri Sep 16 09:58:03 2022] DELETE /compute/v2.1/os-volumes/bfebc89a-cb80-4845-8db6-9f3c0151e772 => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 09:58:04.131644 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-edbd3c31-ddfd-4697-b12a-93d7c97ad5b7 tempest-VolumesSnapshotsTestJSON-1309084218 tempest-VolumesSnapshotsTestJSON-1309084218-project] Calling method '.version_select at 0x7ffa6dc1f4c0>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:58:04.178239 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-edbd3c31-ddfd-4697-b12a-93d7c97ad5b7 tempest-VolumesSnapshotsTestJSON-1309084218 tempest-VolumesSnapshotsTestJSON-1309084218-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/bfebc89a-cb80-4845-8db6-9f3c0151e772" status: 200 len: 343 microversion: 2.1 time: 0.050613 Sep 16 09:58:04.178823 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 489/976] 10.222.0.73 () {58 vars in 1245 bytes} [Fri Sep 16 09:58:04 2022] GET /compute/v2.1/os-volumes/bfebc89a-cb80-4845-8db6-9f3c0151e772 => generated 343 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:58:05.193188 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-ced0a9b0-c1f4-4e61-9d63-7a716cd1950e tempest-VolumesSnapshotsTestJSON-1309084218 tempest-VolumesSnapshotsTestJSON-1309084218-project] Calling method '.version_select at 0x7ffa71324d30>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:58:05.222605 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.wsgi [None req-ced0a9b0-c1f4-4e61-9d63-7a716cd1950e tempest-VolumesSnapshotsTestJSON-1309084218 tempest-VolumesSnapshotsTestJSON-1309084218-project] HTTP exception thrown: Volume bfebc89a-cb80-4845-8db6-9f3c0151e772 could not be found. Sep 16 09:58:05.225430 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-ced0a9b0-c1f4-4e61-9d63-7a716cd1950e tempest-VolumesSnapshotsTestJSON-1309084218 tempest-VolumesSnapshotsTestJSON-1309084218-project] Request method failure captured: Sep 16 09:58:05.225430 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: request: GET /compute/v2.1/os-volumes/bfebc89a-cb80-4845-8db6-9f3c0151e772 HTTP/1.1 Sep 16 09:58:05.225430 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept: application/json Sep 16 09:58:05.225430 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Sep 16 09:58:05.225430 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Connection: close Sep 16 09:58:05.225430 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Length: 0 Sep 16 09:58:05.225430 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Type: application/json Sep 16 09:58:05.225430 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Host: 10.222.0.73 Sep 16 09:58:05.225430 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Sep 16 09:58:05.225430 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Sep 16 09:58:05.225430 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjJEiilu4VOX1B5pUXuOg-hPw4UMSyKDF9J_ZgMlGZhj1AnUhK9xgfaTO7hR5fRtPpqK1FV6cqcGGPb9xvmdRlraaJmn_kN2yZuG4cFAaJucnYi6jfJ_iGoe4s-an1ELc2SmDM8-qObgqrYOYAjRP2iUW9063YNrXIxvVN2r1UAeDgIjg Sep 16 09:58:05.225430 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Sep 16 09:58:05.225430 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Sep 16 09:58:05.225430 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Sep 16 09:58:05.225430 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Sep 16 09:58:05.225430 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Sep 16 09:58:05.225430 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Sep 16 09:58:05.225430 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Id: 1b8e674aa1f34e38b45512d24df5de25 Sep 16 09:58:05.225430 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1309084218 Sep 16 09:58:05.225430 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Role: reader,member Sep 16 09:58:05.225430 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Roles: reader,member Sep 16 09:58:05.227098 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/1b8e674aa1f34e38b45512d24df5de25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_1b8e674aa1f34e38b45512d24df5de25", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/1b8e674aa1f34e38b45512d24df5de25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/1b8e674aa1f34e38b45512d24df5de25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 09:58:05.227098 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1309084218 Sep 16 09:58:05.227098 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Id: 1b8e674aa1f34e38b45512d24df5de25 Sep 16 09:58:05.227098 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1309084218 Sep 16 09:58:05.227098 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User: tempest-VolumesSnapshotsTestJSON-1309084218-project Sep 16 09:58:05.227098 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Sep 16 09:58:05.227098 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Sep 16 09:58:05.227098 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Id: e1254925b4a3442eac3bfb4f07efa186 Sep 16 09:58:05.227098 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1309084218-project Sep 16 09:58:05.227098 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: method: Sep 16 09:58:05.227098 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: exception: Volume bfebc89a-cb80-4845-8db6-9f3c0151e772 could not be found. Sep 16 09:58:05.227098 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: action_args: {'id': 'bfebc89a-cb80-4845-8db6-9f3c0151e772'} Sep 16 09:58:05.227098 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 09:58:05.227930 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:58:05.227930 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 09:58:05.227930 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 09:58:05.227930 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 16 09:58:05.227930 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 16 09:58:05.227930 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 16 09:58:05.227930 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 16 09:58:05.227930 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 09:58:05.227930 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 09:58:05.227930 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 09:58:05.227930 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 09:58:05.227930 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 09:58:05.227930 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 09:58:05.227930 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 09:58:05.227930 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 09:58:05.227930 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bfebc89a-cb80-4845-8db6-9f3c0151e772 could not be found. (HTTP 404) (Request-ID: req-87c111ad-eafb-4e18-b01e-5ae4b47071ff) Sep 16 09:58:05.227930 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:58:05.227930 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:58:05.227930 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:58:05.229105 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:58:05.229105 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 16 09:58:05.229105 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 16 09:58:05.229105 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 16 09:58:05.229105 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 16 09:58:05.229105 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 16 09:58:05.229105 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 16 09:58:05.229105 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 16 09:58:05.229105 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 16 09:58:05.229105 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 09:58:05.229105 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 09:58:05.229105 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 16 09:58:05.229105 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 16 09:58:05.229105 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 16 09:58:05.229105 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 16 09:58:05.229105 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 09:58:05.229105 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 09:58:05.229105 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 09:58:05.229105 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 09:58:05.231485 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 09:58:05.231485 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 09:58:05.231485 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 09:58:05.231485 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 09:58:05.231485 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bfebc89a-cb80-4845-8db6-9f3c0151e772 could not be found. Sep 16 09:58:05.231485 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:58:05.231485 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:58:05.231485 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:58:05.231485 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:58:05.231485 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:58:05.231485 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:58:05.231485 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 09:58:05.231485 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 09:58:05.231485 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 09:58:05.231485 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 09:58:05.231485 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 09:58:05.231485 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:58:05.231485 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 16 09:58:05.231485 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 09:58:05.232878 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bfebc89a-cb80-4845-8db6-9f3c0151e772 could not be found. Sep 16 09:58:05.232878 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:58:05.232878 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:58:05.232878 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:58:05.232878 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:58:05.232878 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:58:05.232878 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:58:05.232878 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 09:58:05.232878 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 09:58:05.232878 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bfebc89a-cb80-4845-8db6-9f3c0151e772 could not be found. Sep 16 09:58:05.232878 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:58:05.232878 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-ced0a9b0-c1f4-4e61-9d63-7a716cd1950e tempest-VolumesSnapshotsTestJSON-1309084218 tempest-VolumesSnapshotsTestJSON-1309084218-project] Returning 404 to user: Volume bfebc89a-cb80-4845-8db6-9f3c0151e772 could not be found. {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 09:58:05.232878 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-ced0a9b0-c1f4-4e61-9d63-7a716cd1950e tempest-VolumesSnapshotsTestJSON-1309084218 tempest-VolumesSnapshotsTestJSON-1309084218-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/bfebc89a-cb80-4845-8db6-9f3c0151e772" status: 404 len: 109 microversion: 2.1 time: 0.039026 Sep 16 09:58:05.232878 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 488/977] 10.222.0.73 () {58 vars in 1245 bytes} [Fri Sep 16 09:58:05 2022] GET /compute/v2.1/os-volumes/bfebc89a-cb80-4845-8db6-9f3c0151e772 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 09:58:05.246372 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-a0c03a71-92c0-4385-8b48-a4bb9dc930c4 tempest-VolumesSnapshotsTestJSON-1309084218 tempest-VolumesSnapshotsTestJSON-1309084218-project] Calling method '.version_select at 0x7ffa6dcc3700>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:58:05.274840 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.wsgi [None req-a0c03a71-92c0-4385-8b48-a4bb9dc930c4 tempest-VolumesSnapshotsTestJSON-1309084218 tempest-VolumesSnapshotsTestJSON-1309084218-project] HTTP exception thrown: Volume bfebc89a-cb80-4845-8db6-9f3c0151e772 could not be found. Sep 16 09:58:05.284713 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-a0c03a71-92c0-4385-8b48-a4bb9dc930c4 tempest-VolumesSnapshotsTestJSON-1309084218 tempest-VolumesSnapshotsTestJSON-1309084218-project] Request method failure captured: Sep 16 09:58:05.284713 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: request: DELETE /compute/v2.1/os-volumes/bfebc89a-cb80-4845-8db6-9f3c0151e772 HTTP/1.1 Sep 16 09:58:05.284713 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept: application/json Sep 16 09:58:05.284713 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept-Encoding: identity Sep 16 09:58:05.284713 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Connection: close Sep 16 09:58:05.284713 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Length: 0 Sep 16 09:58:05.284713 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Type: application/json Sep 16 09:58:05.284713 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Host: 10.222.0.73 Sep 16 09:58:05.284713 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Openstack-System-Scope: None Sep 16 09:58:05.284713 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: User-Agent: python-urllib3/1.26.12 Sep 16 09:58:05.284713 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Auth-Token: gAAAAABjJEiilu4VOX1B5pUXuOg-hPw4UMSyKDF9J_ZgMlGZhj1AnUhK9xgfaTO7hR5fRtPpqK1FV6cqcGGPb9xvmdRlraaJmn_kN2yZuG4cFAaJucnYi6jfJ_iGoe4s-an1ELc2SmDM8-qObgqrYOYAjRP2iUW9063YNrXIxvVN2r1UAeDgIjg Sep 16 09:58:05.284713 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Id: None Sep 16 09:58:05.284713 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Name: None Sep 16 09:58:05.284713 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Identity-Status: Confirmed Sep 16 09:58:05.284713 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Is-Admin-Project: True Sep 16 09:58:05.284713 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Id: default Sep 16 09:58:05.284713 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Name: Default Sep 16 09:58:05.284713 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Id: 1b8e674aa1f34e38b45512d24df5de25 Sep 16 09:58:05.284713 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1309084218 Sep 16 09:58:05.284713 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Role: reader,member Sep 16 09:58:05.284713 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Roles: reader,member Sep 16 09:58:05.286360 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/1b8e674aa1f34e38b45512d24df5de25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_1b8e674aa1f34e38b45512d24df5de25", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/1b8e674aa1f34e38b45512d24df5de25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/1b8e674aa1f34e38b45512d24df5de25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 09:58:05.286360 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1309084218 Sep 16 09:58:05.286360 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Id: 1b8e674aa1f34e38b45512d24df5de25 Sep 16 09:58:05.286360 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1309084218 Sep 16 09:58:05.286360 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User: tempest-VolumesSnapshotsTestJSON-1309084218-project Sep 16 09:58:05.286360 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Id: default Sep 16 09:58:05.286360 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Name: Default Sep 16 09:58:05.286360 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Id: e1254925b4a3442eac3bfb4f07efa186 Sep 16 09:58:05.286360 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1309084218-project Sep 16 09:58:05.286360 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: method: Sep 16 09:58:05.286360 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: exception: Volume bfebc89a-cb80-4845-8db6-9f3c0151e772 could not be found. Sep 16 09:58:05.286360 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: action_args: {'id': 'bfebc89a-cb80-4845-8db6-9f3c0151e772'} Sep 16 09:58:05.286360 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 09:58:05.287360 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:58:05.287360 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 09:58:05.287360 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 09:58:05.287360 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 16 09:58:05.287360 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 16 09:58:05.287360 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 16 09:58:05.287360 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 16 09:58:05.287360 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 16 09:58:05.287360 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 16 09:58:05.287360 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 16 09:58:05.287360 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 16 09:58:05.287360 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 09:58:05.287360 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 09:58:05.287360 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 09:58:05.287360 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 09:58:05.287360 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bfebc89a-cb80-4845-8db6-9f3c0151e772 could not be found. (HTTP 404) (Request-ID: req-a77f755c-0cfe-4134-a768-ee3ec0fb08a1) Sep 16 09:58:05.287360 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:58:05.287360 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:58:05.287360 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:58:05.288822 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:58:05.288822 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 16 09:58:05.288822 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 16 09:58:05.288822 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 16 09:58:05.288822 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 16 09:58:05.288822 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 16 09:58:05.288822 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 16 09:58:05.288822 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 16 09:58:05.288822 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 16 09:58:05.288822 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 09:58:05.288822 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 09:58:05.288822 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 16 09:58:05.288822 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 16 09:58:05.288822 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 16 09:58:05.288822 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 16 09:58:05.288822 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 16 09:58:05.288822 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 16 09:58:05.288822 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 16 09:58:05.288822 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 16 09:58:05.290224 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 09:58:05.290224 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 09:58:05.290224 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 09:58:05.290224 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 09:58:05.290224 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bfebc89a-cb80-4845-8db6-9f3c0151e772 could not be found. Sep 16 09:58:05.290224 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:58:05.290224 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:58:05.290224 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:58:05.290224 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:58:05.290224 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:58:05.290224 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:58:05.290224 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 09:58:05.290224 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 09:58:05.290224 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 09:58:05.290224 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 09:58:05.290224 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 09:58:05.290224 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:58:05.290224 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 16 09:58:05.290224 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 09:58:05.291716 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bfebc89a-cb80-4845-8db6-9f3c0151e772 could not be found. Sep 16 09:58:05.291716 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:58:05.291716 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:58:05.291716 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:58:05.291716 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:58:05.291716 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:58:05.291716 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:58:05.291716 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 09:58:05.291716 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 09:58:05.291716 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bfebc89a-cb80-4845-8db6-9f3c0151e772 could not be found. Sep 16 09:58:05.291716 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:58:05.291716 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-a0c03a71-92c0-4385-8b48-a4bb9dc930c4 tempest-VolumesSnapshotsTestJSON-1309084218 tempest-VolumesSnapshotsTestJSON-1309084218-project] Returning 404 to user: Volume bfebc89a-cb80-4845-8db6-9f3c0151e772 could not be found. {{(pid=127671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 09:58:05.291716 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-a0c03a71-92c0-4385-8b48-a4bb9dc930c4 tempest-VolumesSnapshotsTestJSON-1309084218 tempest-VolumesSnapshotsTestJSON-1309084218-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/bfebc89a-cb80-4845-8db6-9f3c0151e772" status: 404 len: 109 microversion: 2.1 time: 0.037375 Sep 16 09:58:05.291716 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 490/978] 10.222.0.73 () {58 vars in 1248 bytes} [Fri Sep 16 09:58:05 2022] DELETE /compute/v2.1/os-volumes/bfebc89a-cb80-4845-8db6-9f3c0151e772 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 09:58:05.293440 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-4acbbffa-ec2d-4460-8ca9-5879fa80e057 tempest-VolumesSnapshotsTestJSON-1309084218 tempest-VolumesSnapshotsTestJSON-1309084218-project] Calling method '.version_select at 0x7ffa6dc62550>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:58:05.316646 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.wsgi [None req-4acbbffa-ec2d-4460-8ca9-5879fa80e057 tempest-VolumesSnapshotsTestJSON-1309084218 tempest-VolumesSnapshotsTestJSON-1309084218-project] HTTP exception thrown: Volume bfebc89a-cb80-4845-8db6-9f3c0151e772 could not be found. Sep 16 09:58:05.318672 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-4acbbffa-ec2d-4460-8ca9-5879fa80e057 tempest-VolumesSnapshotsTestJSON-1309084218 tempest-VolumesSnapshotsTestJSON-1309084218-project] Request method failure captured: Sep 16 09:58:05.318672 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: request: GET /compute/v2.1/os-volumes/bfebc89a-cb80-4845-8db6-9f3c0151e772 HTTP/1.1 Sep 16 09:58:05.318672 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept: application/json Sep 16 09:58:05.318672 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Sep 16 09:58:05.318672 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Connection: close Sep 16 09:58:05.318672 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Length: 0 Sep 16 09:58:05.318672 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Type: application/json Sep 16 09:58:05.318672 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Host: 10.222.0.73 Sep 16 09:58:05.318672 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Sep 16 09:58:05.318672 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Sep 16 09:58:05.318672 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjJEiilu4VOX1B5pUXuOg-hPw4UMSyKDF9J_ZgMlGZhj1AnUhK9xgfaTO7hR5fRtPpqK1FV6cqcGGPb9xvmdRlraaJmn_kN2yZuG4cFAaJucnYi6jfJ_iGoe4s-an1ELc2SmDM8-qObgqrYOYAjRP2iUW9063YNrXIxvVN2r1UAeDgIjg Sep 16 09:58:05.318672 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Sep 16 09:58:05.318672 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Sep 16 09:58:05.318672 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Sep 16 09:58:05.318672 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Sep 16 09:58:05.318672 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Sep 16 09:58:05.318672 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Sep 16 09:58:05.318672 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Id: 1b8e674aa1f34e38b45512d24df5de25 Sep 16 09:58:05.318672 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1309084218 Sep 16 09:58:05.318672 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Role: reader,member Sep 16 09:58:05.318672 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Roles: reader,member Sep 16 09:58:05.320281 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/1b8e674aa1f34e38b45512d24df5de25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_1b8e674aa1f34e38b45512d24df5de25", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/1b8e674aa1f34e38b45512d24df5de25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/1b8e674aa1f34e38b45512d24df5de25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 09:58:05.320281 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1309084218 Sep 16 09:58:05.320281 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Id: 1b8e674aa1f34e38b45512d24df5de25 Sep 16 09:58:05.320281 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1309084218 Sep 16 09:58:05.320281 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User: tempest-VolumesSnapshotsTestJSON-1309084218-project Sep 16 09:58:05.320281 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Sep 16 09:58:05.320281 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Sep 16 09:58:05.320281 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Id: e1254925b4a3442eac3bfb4f07efa186 Sep 16 09:58:05.320281 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1309084218-project Sep 16 09:58:05.320281 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: method: Sep 16 09:58:05.320281 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: exception: Volume bfebc89a-cb80-4845-8db6-9f3c0151e772 could not be found. Sep 16 09:58:05.320281 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: action_args: {'id': 'bfebc89a-cb80-4845-8db6-9f3c0151e772'} Sep 16 09:58:05.320281 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 09:58:05.321247 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:58:05.321247 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 09:58:05.321247 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 09:58:05.321247 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 16 09:58:05.321247 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 16 09:58:05.321247 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 16 09:58:05.321247 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 16 09:58:05.321247 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 09:58:05.321247 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 09:58:05.321247 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 09:58:05.321247 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 09:58:05.321247 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 09:58:05.321247 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 09:58:05.321247 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 09:58:05.321247 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 09:58:05.321247 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bfebc89a-cb80-4845-8db6-9f3c0151e772 could not be found. (HTTP 404) (Request-ID: req-f4d9ddc7-018e-4ce7-8982-e65cdd4a9224) Sep 16 09:58:05.321247 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:58:05.321247 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:58:05.321247 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:58:05.332223 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:58:05.332223 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 16 09:58:05.332223 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 16 09:58:05.332223 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 16 09:58:05.332223 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 16 09:58:05.332223 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 16 09:58:05.332223 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 16 09:58:05.332223 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 16 09:58:05.332223 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 16 09:58:05.332223 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 09:58:05.332223 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 09:58:05.332223 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 16 09:58:05.332223 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 16 09:58:05.332223 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 16 09:58:05.332223 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 16 09:58:05.332223 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 09:58:05.332223 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 09:58:05.332223 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 09:58:05.332223 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 09:58:05.333589 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 09:58:05.333589 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 09:58:05.333589 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 09:58:05.333589 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 09:58:05.333589 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bfebc89a-cb80-4845-8db6-9f3c0151e772 could not be found. Sep 16 09:58:05.333589 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:58:05.333589 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:58:05.333589 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:58:05.333589 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:58:05.333589 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:58:05.333589 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:58:05.333589 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 09:58:05.333589 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 09:58:05.333589 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 09:58:05.333589 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 09:58:05.333589 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 09:58:05.333589 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:58:05.333589 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 16 09:58:05.333589 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 09:58:05.334996 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bfebc89a-cb80-4845-8db6-9f3c0151e772 could not be found. Sep 16 09:58:05.334996 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:58:05.334996 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:58:05.334996 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:58:05.334996 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:58:05.334996 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:58:05.334996 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:58:05.334996 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 09:58:05.334996 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 09:58:05.334996 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bfebc89a-cb80-4845-8db6-9f3c0151e772 could not be found. Sep 16 09:58:05.334996 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:58:05.334996 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-4acbbffa-ec2d-4460-8ca9-5879fa80e057 tempest-VolumesSnapshotsTestJSON-1309084218 tempest-VolumesSnapshotsTestJSON-1309084218-project] Returning 404 to user: Volume bfebc89a-cb80-4845-8db6-9f3c0151e772 could not be found. {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 09:58:05.334996 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-4acbbffa-ec2d-4460-8ca9-5879fa80e057 tempest-VolumesSnapshotsTestJSON-1309084218 tempest-VolumesSnapshotsTestJSON-1309084218-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/bfebc89a-cb80-4845-8db6-9f3c0151e772" status: 404 len: 109 microversion: 2.1 time: 0.036350 Sep 16 09:58:05.334996 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 489/979] 10.222.0.73 () {58 vars in 1245 bytes} [Fri Sep 16 09:58:05 2022] GET /compute/v2.1/os-volumes/bfebc89a-cb80-4845-8db6-9f3c0151e772 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 09:58:10.607558 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-9baa24aa-f02f-419d-8bb4-151e15c6b02e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:58:10.611545 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-9baa24aa-f02f-419d-8bb4-151e15c6b02e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:58:10.617957 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9baa24aa-f02f-419d-8bb4-151e15c6b02e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:10.618476 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9baa24aa-f02f-419d-8bb4-151e15c6b02e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:10.618920 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9baa24aa-f02f-419d-8bb4-151e15c6b02e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:10.619635 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9baa24aa-f02f-419d-8bb4-151e15c6b02e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:10.620154 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9baa24aa-f02f-419d-8bb4-151e15c6b02e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:10.620583 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9baa24aa-f02f-419d-8bb4-151e15c6b02e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:10.652196 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-9baa24aa-f02f-419d-8bb4-151e15c6b02e tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051386 Sep 16 09:58:10.653685 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 491/980] 10.222.0.73 () {60 vars in 1343 bytes} [Fri Sep 16 09:58:10 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:58:10.722514 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-4ab7c1e9-06b4-4b15-8190-a169a8083bed tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:58:10.723034 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-4ab7c1e9-06b4-4b15-8190-a169a8083bed tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:58:10.730328 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4ab7c1e9-06b4-4b15-8190-a169a8083bed tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:10.731040 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4ab7c1e9-06b4-4b15-8190-a169a8083bed tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:10.731491 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4ab7c1e9-06b4-4b15-8190-a169a8083bed tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:10.732203 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4ab7c1e9-06b4-4b15-8190-a169a8083bed tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:10.732670 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4ab7c1e9-06b4-4b15-8190-a169a8083bed tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:10.733102 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4ab7c1e9-06b4-4b15-8190-a169a8083bed tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:10.758563 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-4ab7c1e9-06b4-4b15-8190-a169a8083bed tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Going to try to terminate instance {{(pid=127670) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 09:58:11.111784 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-4ab7c1e9-06b4-4b15-8190-a169a8083bed tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "DELETE /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 204 len: 0 microversion: 2.20 time: 0.394719 Sep 16 09:58:11.112987 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 490/981] 10.222.0.73 () {60 vars in 1280 bytes} [Fri Sep 16 09:58:10 2022] DELETE /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 09:58:11.121567 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-31fda396-6a47-4048-8288-4932030f28f9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:58:11.122198 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-31fda396-6a47-4048-8288-4932030f28f9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:58:11.128998 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-31fda396-6a47-4048-8288-4932030f28f9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:11.129565 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-31fda396-6a47-4048-8288-4932030f28f9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:11.130259 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-31fda396-6a47-4048-8288-4932030f28f9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:11.130959 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-31fda396-6a47-4048-8288-4932030f28f9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:11.131415 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-31fda396-6a47-4048-8288-4932030f28f9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:11.131892 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-31fda396-6a47-4048-8288-4932030f28f9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:11.275941 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-31fda396-6a47-4048-8288-4932030f28f9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:58:11.285259 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-31fda396-6a47-4048-8288-4932030f28f9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:58:11.286762 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-31fda396-6a47-4048-8288-4932030f28f9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:58:11.289989 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-31fda396-6a47-4048-8288-4932030f28f9 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1723 microversion: 2.20 time: 0.170335 Sep 16 09:58:11.289989 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 492/982] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:58:11 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 09:58:12.314824 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-f24f78bc-152e-4ff8-bb77-0bc32fa4f034 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:58:12.315409 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-f24f78bc-152e-4ff8-bb77-0bc32fa4f034 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:58:12.322143 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f24f78bc-152e-4ff8-bb77-0bc32fa4f034 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:12.322334 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f24f78bc-152e-4ff8-bb77-0bc32fa4f034 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:12.322726 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f24f78bc-152e-4ff8-bb77-0bc32fa4f034 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:12.323436 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f24f78bc-152e-4ff8-bb77-0bc32fa4f034 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:12.323898 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f24f78bc-152e-4ff8-bb77-0bc32fa4f034 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:12.324330 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f24f78bc-152e-4ff8-bb77-0bc32fa4f034 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:12.475113 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f24f78bc-152e-4ff8-bb77-0bc32fa4f034 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:58:12.484059 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f24f78bc-152e-4ff8-bb77-0bc32fa4f034 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:58:12.485506 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f24f78bc-152e-4ff8-bb77-0bc32fa4f034 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:58:12.486724 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-f24f78bc-152e-4ff8-bb77-0bc32fa4f034 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1723 microversion: 2.20 time: 0.176306 Sep 16 09:58:12.487461 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 491/983] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:58:12 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:58:13.501755 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [req-1e9ce1ab-ca47-4cc2-9533-8fe732534a47 req-81f830de-cb9f-43df-bf3b-e74fd1f1bc79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0f4a754-d9db-4829-a2f8-677cc9c34fbc", "name": "network-vif-deleted", "tag": "789fb3b6-eef8-4edd-a929-e88fed92432d"}]} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:58:13.511592 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-1e9ce1ab-ca47-4cc2-9533-8fe732534a47 req-81f830de-cb9f-43df-bf3b-e74fd1f1bc79 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:13.512123 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-1e9ce1ab-ca47-4cc2-9533-8fe732534a47 req-81f830de-cb9f-43df-bf3b-e74fd1f1bc79 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:13.512244 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-021e754d-a3c1-4fde-81b4-ef49116ed323 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:58:13.512752 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-1e9ce1ab-ca47-4cc2-9533-8fe732534a47 req-81f830de-cb9f-43df-bf3b-e74fd1f1bc79 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:13.513105 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-021e754d-a3c1-4fde-81b4-ef49116ed323 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:58:13.519398 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-021e754d-a3c1-4fde-81b4-ef49116ed323 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:13.520000 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-021e754d-a3c1-4fde-81b4-ef49116ed323 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:13.520669 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-021e754d-a3c1-4fde-81b4-ef49116ed323 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:13.521616 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-021e754d-a3c1-4fde-81b4-ef49116ed323 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:13.522146 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-021e754d-a3c1-4fde-81b4-ef49116ed323 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:13.522797 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-021e754d-a3c1-4fde-81b4-ef49116ed323 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:13.523919 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.compute.server_external_events [req-1e9ce1ab-ca47-4cc2-9533-8fe732534a47 req-81f830de-cb9f-43df-bf3b-e74fd1f1bc79 service nova] Creating event network-vif-deleted:789fb3b6-eef8-4edd-a929-e88fed92432d for instance e0f4a754-d9db-4829-a2f8-677cc9c34fbc on hv-cinder-79053 Sep 16 09:58:13.529812 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [req-1e9ce1ab-ca47-4cc2-9533-8fe732534a47 req-81f830de-cb9f-43df-bf3b-e74fd1f1bc79 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031657 Sep 16 09:58:13.530747 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 493/984] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:58:13.594496 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-021e754d-a3c1-4fde-81b4-ef49116ed323 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:58:13.606867 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-021e754d-a3c1-4fde-81b4-ef49116ed323 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:58:13.606867 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-021e754d-a3c1-4fde-81b4-ef49116ed323 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc95a607e1ef43d592a5289f80464424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1713f13f3ff494496a8ef8e5591c1b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:58:13.609459 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-021e754d-a3c1-4fde-81b4-ef49116ed323 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 200 len: 1656 microversion: 2.20 time: 0.099752 Sep 16 09:58:13.610523 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 492/985] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:58:13 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 1656 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 09:58:14.637913 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-79782a0d-6317-4c8a-89ec-dc89c3bb6f73 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:58:14.638617 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-79782a0d-6317-4c8a-89ec-dc89c3bb6f73 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:58:14.645463 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-79782a0d-6317-4c8a-89ec-dc89c3bb6f73 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:14.646224 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-79782a0d-6317-4c8a-89ec-dc89c3bb6f73 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:14.646666 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-79782a0d-6317-4c8a-89ec-dc89c3bb6f73 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:14.648418 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-79782a0d-6317-4c8a-89ec-dc89c3bb6f73 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:14.648940 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-79782a0d-6317-4c8a-89ec-dc89c3bb6f73 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:14.650046 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-79782a0d-6317-4c8a-89ec-dc89c3bb6f73 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:14.667931 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.wsgi [None req-79782a0d-6317-4c8a-89ec-dc89c3bb6f73 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] HTTP exception thrown: Instance e0f4a754-d9db-4829-a2f8-677cc9c34fbc could not be found. Sep 16 09:58:14.671253 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-79782a0d-6317-4c8a-89ec-dc89c3bb6f73 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Request method failure captured: Sep 16 09:58:14.671253 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: request: GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc HTTP/1.1 Sep 16 09:58:14.671253 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept: application/json Sep 16 09:58:14.671253 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept-Encoding: identity Sep 16 09:58:14.671253 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Connection: close Sep 16 09:58:14.671253 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Length: 0 Sep 16 09:58:14.671253 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Type: application/json Sep 16 09:58:14.671253 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Host: 10.222.0.73 Sep 16 09:58:14.671253 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Openstack-System-Scope: None Sep 16 09:58:14.671253 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: User-Agent: python-urllib3/1.26.12 Sep 16 09:58:14.671253 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Auth-Token: gAAAAABjJEbuAhf_iy02su7H6mZZHK5Z0-ZEvaCoRUZk2uYc9XMuB19tGSi2hqksSycPPIpATdk9yC5vMP1JDiTm76CI-nTH1tXyQaObI5pB3VQDdECAxF1WLMWv8DyYGvuygryKGplX-aJg9K2GwKxt6LMHbAPrjHQXrpgprHxp709LujVSSb4 Sep 16 09:58:14.671253 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Id: None Sep 16 09:58:14.671253 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Name: None Sep 16 09:58:14.671253 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Identity-Status: Confirmed Sep 16 09:58:14.671253 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Is-Admin-Project: True Sep 16 09:58:14.671253 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Openstack-Nova-Api-Version: 2.20 Sep 16 09:58:14.671253 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Id: default Sep 16 09:58:14.671253 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Name: Default Sep 16 09:58:14.671253 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Id: f1713f13f3ff494496a8ef8e5591c1b6 Sep 16 09:58:14.671253 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-359947208 Sep 16 09:58:14.671253 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Role: reader,member Sep 16 09:58:14.671253 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Roles: reader,member Sep 16 09:58:14.673026 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f1713f13f3ff494496a8ef8e5591c1b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_f1713f13f3ff494496a8ef8e5591c1b6", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f1713f13f3ff494496a8ef8e5591c1b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/f1713f13f3ff494496a8ef8e5591c1b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 09:58:14.673026 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant: tempest-AttachVolumeShelveTestJSON-359947208 Sep 16 09:58:14.673026 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Id: f1713f13f3ff494496a8ef8e5591c1b6 Sep 16 09:58:14.673026 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-359947208 Sep 16 09:58:14.673026 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User: tempest-AttachVolumeShelveTestJSON-359947208-project Sep 16 09:58:14.673026 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Id: default Sep 16 09:58:14.673026 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Name: Default Sep 16 09:58:14.673026 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Id: bc95a607e1ef43d592a5289f80464424 Sep 16 09:58:14.673026 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Name: tempest-AttachVolumeShelveTestJSON-359947208-project Sep 16 09:58:14.673026 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: method: > Sep 16 09:58:14.673026 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: exception: Instance e0f4a754-d9db-4829-a2f8-677cc9c34fbc could not be found. Sep 16 09:58:14.673026 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: action_args: {'id': 'e0f4a754-d9db-4829-a2f8-677cc9c34fbc'} Sep 16 09:58:14.673966 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 09:58:14.673966 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:58:14.673966 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 09:58:14.673966 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 09:58:14.673966 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 09:58:14.673966 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 09:58:14.673966 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 09:58:14.673966 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 09:58:14.673966 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 09:58:14.673966 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 09:58:14.673966 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0f4a754-d9db-4829-a2f8-677cc9c34fbc could not be found. Sep 16 09:58:14.673966 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:58:14.673966 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:58:14.673966 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:58:14.673966 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:58:14.673966 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:58:14.673966 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:58:14.673966 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 09:58:14.673966 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 09:58:14.673966 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 09:58:14.675448 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:58:14.675448 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 09:58:14.675448 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 09:58:14.675448 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 09:58:14.675448 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 09:58:14.675448 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 09:58:14.675448 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 09:58:14.675448 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0f4a754-d9db-4829-a2f8-677cc9c34fbc could not be found. Sep 16 09:58:14.675448 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:58:14.675448 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:58:14.675448 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:58:14.675448 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:58:14.675448 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:58:14.675448 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:58:14.675448 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 09:58:14.675448 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 09:58:14.675448 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0f4a754-d9db-4829-a2f8-677cc9c34fbc could not be found. Sep 16 09:58:14.675448 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:58:14.678072 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-79782a0d-6317-4c8a-89ec-dc89c3bb6f73 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Returning 404 to user: Instance e0f4a754-d9db-4829-a2f8-677cc9c34fbc could not be found. {{(pid=127671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 09:58:14.678953 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-79782a0d-6317-4c8a-89ec-dc89c3bb6f73 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 404 len: 111 microversion: 2.20 time: 0.046322 Sep 16 09:58:14.690301 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 494/986] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:58:14 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 09:58:14.691052 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-c54efc44-bc57-41d7-9f1a-9e635f5e8aa6 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '.version_select at 0x7ffa6dc639d0>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:58:14.820843 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-c54efc44-bc57-41d7-9f1a-9e635f5e8aa6 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1742301879" status: 204 len: 0 microversion: 2.20 time: 0.135593 Sep 16 09:58:14.821653 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 493/987] 10.222.0.73 () {60 vars in 1262 bytes} [Fri Sep 16 09:58:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1742301879 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 16 09:58:17.476579 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-3273c6ca-a9b4-4b5d-8de0-55e9dc14e824 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:58:17.477136 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-3273c6ca-a9b4-4b5d-8de0-55e9dc14e824 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:58:17.493377 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3273c6ca-a9b4-4b5d-8de0-55e9dc14e824 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:17.494065 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3273c6ca-a9b4-4b5d-8de0-55e9dc14e824 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:17.494526 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3273c6ca-a9b4-4b5d-8de0-55e9dc14e824 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:17.495269 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3273c6ca-a9b4-4b5d-8de0-55e9dc14e824 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:17.495744 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3273c6ca-a9b4-4b5d-8de0-55e9dc14e824 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:17.496955 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3273c6ca-a9b4-4b5d-8de0-55e9dc14e824 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:17.524570 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.wsgi [None req-3273c6ca-a9b4-4b5d-8de0-55e9dc14e824 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] HTTP exception thrown: Instance e0f4a754-d9db-4829-a2f8-677cc9c34fbc could not be found. Sep 16 09:58:17.526193 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-3273c6ca-a9b4-4b5d-8de0-55e9dc14e824 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Request method failure captured: Sep 16 09:58:17.526193 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: request: DELETE /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc HTTP/1.1 Sep 16 09:58:17.526193 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept: application/json Sep 16 09:58:17.526193 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept-Encoding: identity Sep 16 09:58:17.526193 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Connection: close Sep 16 09:58:17.526193 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Length: 0 Sep 16 09:58:17.526193 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Type: application/json Sep 16 09:58:17.526193 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Host: 10.222.0.73 Sep 16 09:58:17.526193 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Openstack-System-Scope: None Sep 16 09:58:17.526193 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: User-Agent: python-urllib3/1.26.12 Sep 16 09:58:17.526193 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Auth-Token: gAAAAABjJEbuAhf_iy02su7H6mZZHK5Z0-ZEvaCoRUZk2uYc9XMuB19tGSi2hqksSycPPIpATdk9yC5vMP1JDiTm76CI-nTH1tXyQaObI5pB3VQDdECAxF1WLMWv8DyYGvuygryKGplX-aJg9K2GwKxt6LMHbAPrjHQXrpgprHxp709LujVSSb4 Sep 16 09:58:17.526193 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Id: None Sep 16 09:58:17.526193 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Name: None Sep 16 09:58:17.526193 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Identity-Status: Confirmed Sep 16 09:58:17.526193 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Is-Admin-Project: True Sep 16 09:58:17.526193 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Openstack-Nova-Api-Version: 2.20 Sep 16 09:58:17.526193 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Id: default Sep 16 09:58:17.526193 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Name: Default Sep 16 09:58:17.526193 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Id: f1713f13f3ff494496a8ef8e5591c1b6 Sep 16 09:58:17.526193 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-359947208 Sep 16 09:58:17.526193 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Role: reader,member Sep 16 09:58:17.526193 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Roles: reader,member Sep 16 09:58:17.528265 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f1713f13f3ff494496a8ef8e5591c1b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_f1713f13f3ff494496a8ef8e5591c1b6", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f1713f13f3ff494496a8ef8e5591c1b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/f1713f13f3ff494496a8ef8e5591c1b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 09:58:17.528265 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant: tempest-AttachVolumeShelveTestJSON-359947208 Sep 16 09:58:17.528265 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Id: f1713f13f3ff494496a8ef8e5591c1b6 Sep 16 09:58:17.528265 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-359947208 Sep 16 09:58:17.528265 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User: tempest-AttachVolumeShelveTestJSON-359947208-project Sep 16 09:58:17.528265 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Id: default Sep 16 09:58:17.528265 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Name: Default Sep 16 09:58:17.528265 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Id: bc95a607e1ef43d592a5289f80464424 Sep 16 09:58:17.528265 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Name: tempest-AttachVolumeShelveTestJSON-359947208-project Sep 16 09:58:17.528265 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: method: > Sep 16 09:58:17.528265 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: exception: Instance e0f4a754-d9db-4829-a2f8-677cc9c34fbc could not be found. Sep 16 09:58:17.528265 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: action_args: {'id': 'e0f4a754-d9db-4829-a2f8-677cc9c34fbc'} Sep 16 09:58:17.529246 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 09:58:17.529246 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:58:17.529246 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 09:58:17.529246 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 09:58:17.529246 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 09:58:17.529246 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 09:58:17.529246 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 09:58:17.529246 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 09:58:17.529246 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 09:58:17.529246 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 09:58:17.529246 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0f4a754-d9db-4829-a2f8-677cc9c34fbc could not be found. Sep 16 09:58:17.529246 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:58:17.529246 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:58:17.529246 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:58:17.529246 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:58:17.529246 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:58:17.529246 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:58:17.529246 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 09:58:17.529246 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 09:58:17.529246 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 09:58:17.530711 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:58:17.530711 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 09:58:17.530711 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 09:58:17.530711 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 09:58:17.530711 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 09:58:17.530711 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 09:58:17.530711 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 09:58:17.530711 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 09:58:17.530711 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 09:58:17.530711 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0f4a754-d9db-4829-a2f8-677cc9c34fbc could not be found. Sep 16 09:58:17.530711 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:58:17.530711 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:58:17.530711 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:58:17.530711 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:58:17.530711 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:58:17.530711 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:58:17.530711 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 09:58:17.530711 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 09:58:17.530711 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0f4a754-d9db-4829-a2f8-677cc9c34fbc could not be found. Sep 16 09:58:17.530711 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:58:17.533960 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-3273c6ca-a9b4-4b5d-8de0-55e9dc14e824 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Returning 404 to user: Instance e0f4a754-d9db-4829-a2f8-677cc9c34fbc could not be found. {{(pid=127671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 09:58:17.535028 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-3273c6ca-a9b4-4b5d-8de0-55e9dc14e824 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "DELETE /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 404 len: 111 microversion: 2.20 time: 0.066979 Sep 16 09:58:17.539255 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 495/988] 10.222.0.73 () {60 vars in 1280 bytes} [Fri Sep 16 09:58:17 2022] DELETE /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 09:58:17.545907 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-1ff8803f-bf92-493d-aa36-53076fa5c02b tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:58:17.547175 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-1ff8803f-bf92-493d-aa36-53076fa5c02b tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: e0f4a754-d9db-4829-a2f8-677cc9c34fbc] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:58:17.555785 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1ff8803f-bf92-493d-aa36-53076fa5c02b tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:17.556553 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1ff8803f-bf92-493d-aa36-53076fa5c02b tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:17.557182 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1ff8803f-bf92-493d-aa36-53076fa5c02b tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:17.566757 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1ff8803f-bf92-493d-aa36-53076fa5c02b tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:17.566757 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1ff8803f-bf92-493d-aa36-53076fa5c02b tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:17.566757 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1ff8803f-bf92-493d-aa36-53076fa5c02b tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:17.575291 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.wsgi [None req-1ff8803f-bf92-493d-aa36-53076fa5c02b tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] HTTP exception thrown: Instance e0f4a754-d9db-4829-a2f8-677cc9c34fbc could not be found. Sep 16 09:58:17.577410 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-1ff8803f-bf92-493d-aa36-53076fa5c02b tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Request method failure captured: Sep 16 09:58:17.577410 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: request: GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc HTTP/1.1 Sep 16 09:58:17.577410 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept: application/json Sep 16 09:58:17.577410 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Sep 16 09:58:17.577410 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Connection: close Sep 16 09:58:17.577410 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Length: 0 Sep 16 09:58:17.577410 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Type: application/json Sep 16 09:58:17.577410 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Host: 10.222.0.73 Sep 16 09:58:17.577410 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Sep 16 09:58:17.577410 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Sep 16 09:58:17.577410 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjJEbuAhf_iy02su7H6mZZHK5Z0-ZEvaCoRUZk2uYc9XMuB19tGSi2hqksSycPPIpATdk9yC5vMP1JDiTm76CI-nTH1tXyQaObI5pB3VQDdECAxF1WLMWv8DyYGvuygryKGplX-aJg9K2GwKxt6LMHbAPrjHQXrpgprHxp709LujVSSb4 Sep 16 09:58:17.577410 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Sep 16 09:58:17.577410 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Sep 16 09:58:17.577410 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Sep 16 09:58:17.577410 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Sep 16 09:58:17.577410 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Openstack-Nova-Api-Version: 2.20 Sep 16 09:58:17.577410 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Sep 16 09:58:17.577410 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Sep 16 09:58:17.577410 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Id: f1713f13f3ff494496a8ef8e5591c1b6 Sep 16 09:58:17.577410 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-359947208 Sep 16 09:58:17.577410 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Role: reader,member Sep 16 09:58:17.577410 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Roles: reader,member Sep 16 09:58:17.578864 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f1713f13f3ff494496a8ef8e5591c1b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_f1713f13f3ff494496a8ef8e5591c1b6", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f1713f13f3ff494496a8ef8e5591c1b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/f1713f13f3ff494496a8ef8e5591c1b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 09:58:17.578864 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-AttachVolumeShelveTestJSON-359947208 Sep 16 09:58:17.578864 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Id: f1713f13f3ff494496a8ef8e5591c1b6 Sep 16 09:58:17.578864 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-359947208 Sep 16 09:58:17.578864 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User: tempest-AttachVolumeShelveTestJSON-359947208-project Sep 16 09:58:17.578864 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Sep 16 09:58:17.578864 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Sep 16 09:58:17.578864 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Id: bc95a607e1ef43d592a5289f80464424 Sep 16 09:58:17.578864 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-AttachVolumeShelveTestJSON-359947208-project Sep 16 09:58:17.578864 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: method: > Sep 16 09:58:17.578864 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: exception: Instance e0f4a754-d9db-4829-a2f8-677cc9c34fbc could not be found. Sep 16 09:58:17.578864 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: action_args: {'id': 'e0f4a754-d9db-4829-a2f8-677cc9c34fbc'} Sep 16 09:58:17.579616 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 09:58:17.579616 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:58:17.579616 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 09:58:17.579616 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 09:58:17.579616 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 09:58:17.579616 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 09:58:17.579616 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 09:58:17.579616 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 09:58:17.579616 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 09:58:17.579616 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 09:58:17.579616 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0f4a754-d9db-4829-a2f8-677cc9c34fbc could not be found. Sep 16 09:58:17.579616 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:58:17.579616 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:58:17.579616 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:58:17.579616 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:58:17.579616 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:58:17.579616 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:58:17.579616 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 09:58:17.579616 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 09:58:17.579616 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 09:58:17.580893 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:58:17.580893 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 09:58:17.580893 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 09:58:17.580893 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 09:58:17.580893 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 09:58:17.580893 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 09:58:17.580893 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 09:58:17.580893 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0f4a754-d9db-4829-a2f8-677cc9c34fbc could not be found. Sep 16 09:58:17.580893 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:58:17.580893 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:58:17.580893 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:58:17.580893 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:58:17.580893 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:58:17.580893 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:58:17.580893 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 09:58:17.580893 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 09:58:17.580893 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0f4a754-d9db-4829-a2f8-677cc9c34fbc could not be found. Sep 16 09:58:17.580893 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:58:17.584128 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-1ff8803f-bf92-493d-aa36-53076fa5c02b tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Returning 404 to user: Instance e0f4a754-d9db-4829-a2f8-677cc9c34fbc could not be found. {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 09:58:17.585345 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-1ff8803f-bf92-493d-aa36-53076fa5c02b tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc" status: 404 len: 111 microversion: 2.20 time: 0.045302 Sep 16 09:58:17.586488 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 494/989] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:58:17 2022] GET /compute/v2.1/servers/e0f4a754-d9db-4829-a2f8-677cc9c34fbc => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 09:58:18.956194 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-8a406099-0cd6-4c7f-a476-ccbc880131a0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:58:18.957148 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-8a406099-0cd6-4c7f-a476-ccbc880131a0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:58:18.963216 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8a406099-0cd6-4c7f-a476-ccbc880131a0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:18.963702 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8a406099-0cd6-4c7f-a476-ccbc880131a0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:18.964163 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8a406099-0cd6-4c7f-a476-ccbc880131a0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:18.964888 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8a406099-0cd6-4c7f-a476-ccbc880131a0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:18.965348 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8a406099-0cd6-4c7f-a476-ccbc880131a0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:18.965884 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8a406099-0cd6-4c7f-a476-ccbc880131a0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:18.979788 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.wsgi [None req-8a406099-0cd6-4c7f-a476-ccbc880131a0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] HTTP exception thrown: Instance 88a0813e-ace7-48df-b688-533c8dbc81de could not be found. Sep 16 09:58:18.981909 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-8a406099-0cd6-4c7f-a476-ccbc880131a0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Request method failure captured: Sep 16 09:58:18.981909 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: request: DELETE /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de HTTP/1.1 Sep 16 09:58:18.981909 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept: application/json Sep 16 09:58:18.981909 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept-Encoding: identity Sep 16 09:58:18.981909 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Connection: close Sep 16 09:58:18.981909 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Length: 0 Sep 16 09:58:18.981909 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Type: application/json Sep 16 09:58:18.981909 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Host: 10.222.0.73 Sep 16 09:58:18.981909 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Openstack-System-Scope: None Sep 16 09:58:18.981909 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: User-Agent: python-urllib3/1.26.12 Sep 16 09:58:18.981909 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Auth-Token: gAAAAABjJEbuAhf_iy02su7H6mZZHK5Z0-ZEvaCoRUZk2uYc9XMuB19tGSi2hqksSycPPIpATdk9yC5vMP1JDiTm76CI-nTH1tXyQaObI5pB3VQDdECAxF1WLMWv8DyYGvuygryKGplX-aJg9K2GwKxt6LMHbAPrjHQXrpgprHxp709LujVSSb4 Sep 16 09:58:18.981909 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Id: None Sep 16 09:58:18.981909 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Name: None Sep 16 09:58:18.981909 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Identity-Status: Confirmed Sep 16 09:58:18.981909 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Is-Admin-Project: True Sep 16 09:58:18.981909 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Openstack-Nova-Api-Version: 2.20 Sep 16 09:58:18.981909 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Id: default Sep 16 09:58:18.981909 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Name: Default Sep 16 09:58:18.981909 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Id: f1713f13f3ff494496a8ef8e5591c1b6 Sep 16 09:58:18.981909 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-359947208 Sep 16 09:58:18.981909 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Role: reader,member Sep 16 09:58:18.981909 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Roles: reader,member Sep 16 09:58:18.983460 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f1713f13f3ff494496a8ef8e5591c1b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_f1713f13f3ff494496a8ef8e5591c1b6", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f1713f13f3ff494496a8ef8e5591c1b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/f1713f13f3ff494496a8ef8e5591c1b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 09:58:18.983460 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant: tempest-AttachVolumeShelveTestJSON-359947208 Sep 16 09:58:18.983460 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Id: f1713f13f3ff494496a8ef8e5591c1b6 Sep 16 09:58:18.983460 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-359947208 Sep 16 09:58:18.983460 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User: tempest-AttachVolumeShelveTestJSON-359947208-project Sep 16 09:58:18.983460 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Id: default Sep 16 09:58:18.983460 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Name: Default Sep 16 09:58:18.983460 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Id: bc95a607e1ef43d592a5289f80464424 Sep 16 09:58:18.983460 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Name: tempest-AttachVolumeShelveTestJSON-359947208-project Sep 16 09:58:18.983460 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: method: > Sep 16 09:58:18.983460 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: exception: Instance 88a0813e-ace7-48df-b688-533c8dbc81de could not be found. Sep 16 09:58:18.983460 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: action_args: {'id': '88a0813e-ace7-48df-b688-533c8dbc81de'} Sep 16 09:58:18.984436 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 09:58:18.984436 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:58:18.984436 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 09:58:18.984436 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 09:58:18.984436 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 09:58:18.984436 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 09:58:18.984436 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 09:58:18.984436 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 09:58:18.984436 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 09:58:18.984436 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 09:58:18.984436 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88a0813e-ace7-48df-b688-533c8dbc81de could not be found. Sep 16 09:58:18.984436 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:58:18.984436 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:58:18.984436 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:58:18.984436 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:58:18.984436 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:58:18.984436 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:58:18.984436 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 09:58:18.984436 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 09:58:18.984436 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 09:58:18.986188 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:58:18.986188 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 09:58:18.986188 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 09:58:18.986188 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 09:58:18.986188 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 09:58:18.986188 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 09:58:18.986188 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 09:58:18.986188 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 09:58:18.986188 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 09:58:18.986188 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88a0813e-ace7-48df-b688-533c8dbc81de could not be found. Sep 16 09:58:18.986188 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:58:18.986188 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:58:18.986188 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:58:18.986188 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:58:18.986188 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:58:18.986188 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:58:18.986188 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 09:58:18.986188 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 09:58:18.986188 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88a0813e-ace7-48df-b688-533c8dbc81de could not be found. Sep 16 09:58:18.986188 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 09:58:18.987831 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-8a406099-0cd6-4c7f-a476-ccbc880131a0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Returning 404 to user: Instance 88a0813e-ace7-48df-b688-533c8dbc81de could not be found. {{(pid=127671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 09:58:18.987831 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-8a406099-0cd6-4c7f-a476-ccbc880131a0 tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "DELETE /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 404 len: 111 microversion: 2.20 time: 0.031212 Sep 16 09:58:18.987831 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 496/990] 10.222.0.73 () {60 vars in 1280 bytes} [Fri Sep 16 09:58:18 2022] DELETE /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 09:58:19.018674 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-e1729536-63c7-402f-ab76-98025249596f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:58:19.019298 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-e1729536-63c7-402f-ab76-98025249596f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] [instance: 88a0813e-ace7-48df-b688-533c8dbc81de] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:58:19.025833 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e1729536-63c7-402f-ab76-98025249596f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:19.026321 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e1729536-63c7-402f-ab76-98025249596f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:19.026790 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e1729536-63c7-402f-ab76-98025249596f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:19.027534 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e1729536-63c7-402f-ab76-98025249596f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:19.027992 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e1729536-63c7-402f-ab76-98025249596f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:19.028418 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e1729536-63c7-402f-ab76-98025249596f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:19.041835 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.wsgi [None req-e1729536-63c7-402f-ab76-98025249596f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] HTTP exception thrown: Instance 88a0813e-ace7-48df-b688-533c8dbc81de could not be found. Sep 16 09:58:19.072911 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-e1729536-63c7-402f-ab76-98025249596f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Request method failure captured: Sep 16 09:58:19.072911 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: request: GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de HTTP/1.1 Sep 16 09:58:19.072911 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept: application/json Sep 16 09:58:19.072911 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Sep 16 09:58:19.072911 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Connection: close Sep 16 09:58:19.072911 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Length: 0 Sep 16 09:58:19.072911 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Type: application/json Sep 16 09:58:19.072911 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Host: 10.222.0.73 Sep 16 09:58:19.072911 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Sep 16 09:58:19.072911 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Sep 16 09:58:19.072911 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjJEbuAhf_iy02su7H6mZZHK5Z0-ZEvaCoRUZk2uYc9XMuB19tGSi2hqksSycPPIpATdk9yC5vMP1JDiTm76CI-nTH1tXyQaObI5pB3VQDdECAxF1WLMWv8DyYGvuygryKGplX-aJg9K2GwKxt6LMHbAPrjHQXrpgprHxp709LujVSSb4 Sep 16 09:58:19.072911 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Sep 16 09:58:19.072911 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Sep 16 09:58:19.072911 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Sep 16 09:58:19.072911 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Sep 16 09:58:19.072911 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Openstack-Nova-Api-Version: 2.20 Sep 16 09:58:19.072911 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Sep 16 09:58:19.072911 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Sep 16 09:58:19.072911 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Id: f1713f13f3ff494496a8ef8e5591c1b6 Sep 16 09:58:19.072911 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-359947208 Sep 16 09:58:19.072911 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Role: reader,member Sep 16 09:58:19.072911 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Roles: reader,member Sep 16 09:58:19.075161 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f1713f13f3ff494496a8ef8e5591c1b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_f1713f13f3ff494496a8ef8e5591c1b6", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f1713f13f3ff494496a8ef8e5591c1b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/f1713f13f3ff494496a8ef8e5591c1b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 09:58:19.075161 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-AttachVolumeShelveTestJSON-359947208 Sep 16 09:58:19.075161 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Id: f1713f13f3ff494496a8ef8e5591c1b6 Sep 16 09:58:19.075161 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-359947208 Sep 16 09:58:19.075161 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User: tempest-AttachVolumeShelveTestJSON-359947208-project Sep 16 09:58:19.075161 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Sep 16 09:58:19.075161 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Sep 16 09:58:19.075161 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Id: bc95a607e1ef43d592a5289f80464424 Sep 16 09:58:19.075161 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-AttachVolumeShelveTestJSON-359947208-project Sep 16 09:58:19.075161 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: method: > Sep 16 09:58:19.075161 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: exception: Instance 88a0813e-ace7-48df-b688-533c8dbc81de could not be found. Sep 16 09:58:19.075161 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: action_args: {'id': '88a0813e-ace7-48df-b688-533c8dbc81de'} Sep 16 09:58:19.076344 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 09:58:19.076344 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:58:19.076344 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 09:58:19.076344 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 09:58:19.076344 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 09:58:19.076344 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 09:58:19.076344 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 09:58:19.076344 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 09:58:19.076344 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 09:58:19.076344 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 09:58:19.076344 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88a0813e-ace7-48df-b688-533c8dbc81de could not be found. Sep 16 09:58:19.076344 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:58:19.076344 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:58:19.076344 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:58:19.076344 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:58:19.076344 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:58:19.076344 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:58:19.076344 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 09:58:19.076344 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 09:58:19.076344 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 09:58:19.078380 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 09:58:19.078380 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 09:58:19.078380 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 09:58:19.078380 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 09:58:19.078380 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 09:58:19.078380 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 09:58:19.078380 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 09:58:19.078380 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88a0813e-ace7-48df-b688-533c8dbc81de could not be found. Sep 16 09:58:19.078380 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:58:19.078380 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 09:58:19.078380 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:58:19.078380 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 09:58:19.078380 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 09:58:19.078380 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 09:58:19.078380 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 09:58:19.078380 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 09:58:19.078380 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88a0813e-ace7-48df-b688-533c8dbc81de could not be found. Sep 16 09:58:19.078380 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 09:58:19.079908 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-e1729536-63c7-402f-ab76-98025249596f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] Returning 404 to user: Instance 88a0813e-ace7-48df-b688-533c8dbc81de could not be found. {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 09:58:19.079908 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-e1729536-63c7-402f-ab76-98025249596f tempest-AttachVolumeShelveTestJSON-359947208 tempest-AttachVolumeShelveTestJSON-359947208-project] 10.222.0.73 "GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de" status: 404 len: 111 microversion: 2.20 time: 0.030829 Sep 16 09:58:19.079908 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 495/991] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Sep 16 09:58:19 2022] GET /compute/v2.1/servers/88a0813e-ace7-48df-b688-533c8dbc81de => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 09:58:27.995486 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-b0ce183e-e7d9-4e3d-9d6b-c2272aa743ee tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Action: 'create', calling method: .version_select at 0x7ffa6dc1ff70>, body: {"keypair": {"name": "tempest-TestShelveInstance-222180959", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFLKa4ZXmG7ExbhD7Opq/zhdGPOwqiXMwKqr4mpBDhTLIUVBs0JEDe+OvmKgjyNOgScJ6HzGor3tpZPDB35x5VcMTRzCUNYMG24djdMSC/L/on4mm6blgvepRtNVRTlAEg=="}} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:58:28.022537 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.quota [None req-b0ce183e-e7d9-4e3d-9d6b-c2272aa743ee tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Getting quotas for project 92e292a400454c93a48aca5510bfcee9. Resources: {'key_pairs'} {{(pid=127671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 09:58:28.030473 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.quota [None req-b0ce183e-e7d9-4e3d-9d6b-c2272aa743ee tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Getting quotas for user ff870e07952c4e049e17a096c477165b and project 92e292a400454c93a48aca5510bfcee9. Resources: {'key_pairs'} {{(pid=127671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 09:58:28.165873 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-b0ce183e-e7d9-4e3d-9d6b-c2272aa743ee tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.533273 Sep 16 09:58:28.166476 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 497/992] 10.222.0.73 () {60 vars in 1159 bytes} [Fri Sep 16 09:58:27 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:58:35.546631 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:58:35.547418 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:58:35.687087 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-52a8284d-670b-4f14-82f6-0008d7fa9c18 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Action: 'create', calling method: .version_select at 0x7ffa6dd04a60>, body: {"keypair": {"name": "tempest-keypair-1110492497", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXOdPZipioZdLvRaPddRHmqWXI0UMSHbSa6nSk1ZgvRPxtOBfymmSpe5Y1wDj0aWURZjtO+O7MVcqxdVD/WQl2fPga9ib0u4LT7/imDoOapAa0cs+adl3LQvAzfs/1Xbw=="}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:58:35.704857 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-52a8284d-670b-4f14-82f6-0008d7fa9c18 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Getting quotas for project 75e9f7169b754d5daa040eb465e858e5. Resources: {'key_pairs'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 09:58:35.709350 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-52a8284d-670b-4f14-82f6-0008d7fa9c18 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Getting quotas for user 6ffd25afbc1b42c995ff96c21221b310 and project 75e9f7169b754d5daa040eb465e858e5. Resources: {'key_pairs'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 09:58:35.786178 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-52a8284d-670b-4f14-82f6-0008d7fa9c18 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.245125 Sep 16 09:58:35.786784 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 496/993] 10.222.0.73 () {60 vars in 1159 bytes} [Fri Sep 16 09:58:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:58:38.626266 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell1:SELECT=20 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:58:38.627055 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell0:SELECT=4 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:58:38.627803 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=1 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:58:38.632460 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-7f607582-0610-40e2-b598-65115d0fe9e9 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1496265762", "imageRef": "30d28050-ec9d-4227-9bb0-5247430f6177", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0c5fa5a7-17b8-41e4-80c7-74693b744506"}], "security_groups": [{"name": "tempest-securitygroup--1477245799"}], "key_name": "tempest-keypair-1110492497", "user_data": "}} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:58:38.755073 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.network.neutron [None req-7f607582-0610-40e2-b598-65115d0fe9e9 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] validate_networks() for [('0c5fa5a7-17b8-41e4-80c7-74693b744506', None, None, None, None, None)] {{(pid=127671) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 09:58:39.192299 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.virt.hardware [None req-7f607582-0610-40e2-b598-65115d0fe9e9 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Flavor limits 0:0:0 {{(pid=127671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 09:58:39.192735 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.virt.hardware [None req-7f607582-0610-40e2-b598-65115d0fe9e9 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Image limits 0:0:0 {{(pid=127671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 09:58:39.193442 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.virt.hardware [None req-7f607582-0610-40e2-b598-65115d0fe9e9 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Flavor pref 0:0:0 {{(pid=127671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 09:58:39.193826 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.virt.hardware [None req-7f607582-0610-40e2-b598-65115d0fe9e9 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Image pref 0:0:0 {{(pid=127671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 09:58:39.194311 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.virt.hardware [None req-7f607582-0610-40e2-b598-65115d0fe9e9 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 09:58:39.204280 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7f607582-0610-40e2-b598-65115d0fe9e9 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:39.204772 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7f607582-0610-40e2-b598-65115d0fe9e9 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:39.205235 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7f607582-0610-40e2-b598-65115d0fe9e9 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:39.206016 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7f607582-0610-40e2-b598-65115d0fe9e9 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:39.206485 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7f607582-0610-40e2-b598-65115d0fe9e9 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:39.206902 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7f607582-0610-40e2-b598-65115d0fe9e9 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:39.238249 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.quota [None req-7f607582-0610-40e2-b598-65115d0fe9e9 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Getting quotas for project 75e9f7169b754d5daa040eb465e858e5. Resources: {'instances', 'cores', 'ram'} {{(pid=127671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 09:58:39.242696 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.quota [None req-7f607582-0610-40e2-b598-65115d0fe9e9 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Getting quotas for user 6ffd25afbc1b42c995ff96c21221b310 and project 75e9f7169b754d5daa040eb465e858e5. Resources: {'instances', 'cores', 'ram'} {{(pid=127671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 09:58:39.255312 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-7f607582-0610-40e2-b598-65115d0fe9e9 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Going to run 1 instances... {{(pid=127671) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 09:58:39.257668 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-7f607582-0610-40e2-b598-65115d0fe9e9 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='30d28050-ec9d-4227-9bb0-5247430f6177',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 09:58:39.418427 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-7f607582-0610-40e2-b598-65115d0fe9e9 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.793513 Sep 16 09:58:39.420050 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 498/994] 10.222.0.73 () {60 vars in 1147 bytes} [Fri Sep 16 09:58:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 09:58:39.436649 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-f0ae3d4c-1c29-449b-9086-cec9375dbf49 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:58:39.437869 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-f0ae3d4c-1c29-449b-9086-cec9375dbf49 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:58:39.502054 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f0ae3d4c-1c29-449b-9086-cec9375dbf49 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:58:39.508869 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-f0ae3d4c-1c29-449b-9086-cec9375dbf49 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e" status: 200 len: 1238 microversion: 2.1 time: 0.081662 Sep 16 09:58:39.509438 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 497/995] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:58:39 2022] GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e => generated 1238 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:58:40.533072 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-8ad912d9-bca9-4c7b-b95e-b3ec70e4ffdc tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:58:40.533618 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-8ad912d9-bca9-4c7b-b95e-b3ec70e4ffdc tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:58:40.539982 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8ad912d9-bca9-4c7b-b95e-b3ec70e4ffdc tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:40.540466 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8ad912d9-bca9-4c7b-b95e-b3ec70e4ffdc tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:40.548995 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8ad912d9-bca9-4c7b-b95e-b3ec70e4ffdc tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:40.548995 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8ad912d9-bca9-4c7b-b95e-b3ec70e4ffdc tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:40.548995 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8ad912d9-bca9-4c7b-b95e-b3ec70e4ffdc tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:40.548995 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8ad912d9-bca9-4c7b-b95e-b3ec70e4ffdc tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:40.608747 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-8ad912d9-bca9-4c7b-b95e-b3ec70e4ffdc tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:58:40.616603 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-8ad912d9-bca9-4c7b-b95e-b3ec70e4ffdc tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e" status: 200 len: 1242 microversion: 2.1 time: 0.088108 Sep 16 09:58:40.617162 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 499/996] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:58:40 2022] GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e => generated 1242 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:58:41.640350 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-c2a85ad5-c003-4b06-b0b4-149ccedf8974 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:58:41.640969 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-c2a85ad5-c003-4b06-b0b4-149ccedf8974 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:58:41.647555 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c2a85ad5-c003-4b06-b0b4-149ccedf8974 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:41.648049 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c2a85ad5-c003-4b06-b0b4-149ccedf8974 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:41.648494 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c2a85ad5-c003-4b06-b0b4-149ccedf8974 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:41.649193 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c2a85ad5-c003-4b06-b0b4-149ccedf8974 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:41.649694 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c2a85ad5-c003-4b06-b0b4-149ccedf8974 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:41.650169 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c2a85ad5-c003-4b06-b0b4-149ccedf8974 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:41.716590 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c2a85ad5-c003-4b06-b0b4-149ccedf8974 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:58:41.724813 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-c2a85ad5-c003-4b06-b0b4-149ccedf8974 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e" status: 200 len: 1290 microversion: 2.1 time: 0.088845 Sep 16 09:58:41.725661 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 498/997] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:58:41 2022] GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e => generated 1290 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:58:42.756489 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-8545cfd6-333d-40c8-bda9-f015c3922a30 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:58:42.757154 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-8545cfd6-333d-40c8-bda9-f015c3922a30 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:58:42.764753 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8545cfd6-333d-40c8-bda9-f015c3922a30 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:42.765254 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8545cfd6-333d-40c8-bda9-f015c3922a30 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:42.765735 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8545cfd6-333d-40c8-bda9-f015c3922a30 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:42.766451 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8545cfd6-333d-40c8-bda9-f015c3922a30 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:42.766922 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8545cfd6-333d-40c8-bda9-f015c3922a30 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:42.767351 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8545cfd6-333d-40c8-bda9-f015c3922a30 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:42.940047 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-8545cfd6-333d-40c8-bda9-f015c3922a30 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:58:42.947901 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-8545cfd6-333d-40c8-bda9-f015c3922a30 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e" status: 200 len: 1364 microversion: 2.1 time: 0.195498 Sep 16 09:58:42.948473 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 500/998] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:58:42 2022] GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e => generated 1364 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:58:43.755886 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-bcf4598b-5c11-4b42-804f-2a4d02f51e63 req-665e0b0c-41ed-4a21-b8d8-e2cb16d9d98f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34302fd9-9a71-41c1-8392-6b9df5f0f75e", "tag": "d847971e-055c-4ba7-88f6-3092159ade62"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:58:43.766801 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-bcf4598b-5c11-4b42-804f-2a4d02f51e63 req-665e0b0c-41ed-4a21-b8d8-e2cb16d9d98f service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:43.767281 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-bcf4598b-5c11-4b42-804f-2a4d02f51e63 req-665e0b0c-41ed-4a21-b8d8-e2cb16d9d98f service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:43.767716 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-bcf4598b-5c11-4b42-804f-2a4d02f51e63 req-665e0b0c-41ed-4a21-b8d8-e2cb16d9d98f service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:43.779234 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-bcf4598b-5c11-4b42-804f-2a4d02f51e63 req-665e0b0c-41ed-4a21-b8d8-e2cb16d9d98f service nova] Creating event network-changed:d847971e-055c-4ba7-88f6-3092159ade62 for instance 34302fd9-9a71-41c1-8392-6b9df5f0f75e on hv-cinder-79053 Sep 16 09:58:43.784248 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-bcf4598b-5c11-4b42-804f-2a4d02f51e63 req-665e0b0c-41ed-4a21-b8d8-e2cb16d9d98f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031909 Sep 16 09:58:43.784847 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 499/999] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 09:58:43.973956 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-3af22d48-ac51-4756-88bd-dcaf75c17d75 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:58:43.974566 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-3af22d48-ac51-4756-88bd-dcaf75c17d75 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:58:43.981968 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3af22d48-ac51-4756-88bd-dcaf75c17d75 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:43.982459 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3af22d48-ac51-4756-88bd-dcaf75c17d75 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:43.982895 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3af22d48-ac51-4756-88bd-dcaf75c17d75 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:43.983590 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3af22d48-ac51-4756-88bd-dcaf75c17d75 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:43.984042 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3af22d48-ac51-4756-88bd-dcaf75c17d75 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:43.984464 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3af22d48-ac51-4756-88bd-dcaf75c17d75 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:44.117604 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-3af22d48-ac51-4756-88bd-dcaf75c17d75 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:58:44.126450 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-3af22d48-ac51-4756-88bd-dcaf75c17d75 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e" status: 200 len: 1364 microversion: 2.1 time: 0.156214 Sep 16 09:58:44.127031 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 501/1000] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:58:43 2022] GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:58:45.150182 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d9a45b62-f03e-4902-a7c0-4b1d431c0175 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:58:45.150880 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-d9a45b62-f03e-4902-a7c0-4b1d431c0175 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:58:45.157589 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d9a45b62-f03e-4902-a7c0-4b1d431c0175 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:45.158099 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d9a45b62-f03e-4902-a7c0-4b1d431c0175 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:45.158538 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d9a45b62-f03e-4902-a7c0-4b1d431c0175 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:45.159229 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d9a45b62-f03e-4902-a7c0-4b1d431c0175 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:45.159684 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d9a45b62-f03e-4902-a7c0-4b1d431c0175 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:45.160128 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d9a45b62-f03e-4902-a7c0-4b1d431c0175 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:45.297093 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-d9a45b62-f03e-4902-a7c0-4b1d431c0175 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:58:45.305607 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-d9a45b62-f03e-4902-a7c0-4b1d431c0175 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e" status: 200 len: 1364 microversion: 2.1 time: 0.160074 Sep 16 09:58:45.306164 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 500/1001] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:58:45 2022] GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:58:46.328489 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-4f2ee0b1-8f55-46fe-adfb-0845c135181b tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:58:46.329294 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-4f2ee0b1-8f55-46fe-adfb-0845c135181b tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:58:46.336714 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4f2ee0b1-8f55-46fe-adfb-0845c135181b tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:46.336968 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4f2ee0b1-8f55-46fe-adfb-0845c135181b tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:46.337481 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4f2ee0b1-8f55-46fe-adfb-0845c135181b tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:46.338285 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4f2ee0b1-8f55-46fe-adfb-0845c135181b tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:46.338819 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4f2ee0b1-8f55-46fe-adfb-0845c135181b tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:46.339319 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4f2ee0b1-8f55-46fe-adfb-0845c135181b tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:46.475456 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-4f2ee0b1-8f55-46fe-adfb-0845c135181b tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:58:46.483131 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-4f2ee0b1-8f55-46fe-adfb-0845c135181b tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e" status: 200 len: 1364 microversion: 2.1 time: 0.158982 Sep 16 09:58:46.488598 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 502/1002] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:58:46 2022] GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:58:47.441395 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-24e27398-26f8-4918-a10d-fbe1d063c65b tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1784207735", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-222180959", "security_groups": [{"name": "tempest-secgroup-smoke-304736498"}], "networks": [{"uuid": "5f818df7-9eb8-4b00-80c1-bc6dbfafca51"}], "block_device_mapping_v2": [{"uuid": "75a75e17-bd3c-4f46-98b3-f47ceff621bb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:58:47.505995 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-b7493f1c-db24-421e-b815-8a0d5a3f45cb tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:58:47.506686 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-b7493f1c-db24-421e-b815-8a0d5a3f45cb tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:58:47.513788 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b7493f1c-db24-421e-b815-8a0d5a3f45cb tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:47.514389 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b7493f1c-db24-421e-b815-8a0d5a3f45cb tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:47.514891 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b7493f1c-db24-421e-b815-8a0d5a3f45cb tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:47.515675 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b7493f1c-db24-421e-b815-8a0d5a3f45cb tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:47.516208 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b7493f1c-db24-421e-b815-8a0d5a3f45cb tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:47.516828 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b7493f1c-db24-421e-b815-8a0d5a3f45cb tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:47.559064 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.network.neutron [None req-24e27398-26f8-4918-a10d-fbe1d063c65b tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] validate_networks() for [('5f818df7-9eb8-4b00-80c1-bc6dbfafca51', None, None, None, None, None)] {{(pid=127670) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 09:58:47.651638 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-b7493f1c-db24-421e-b815-8a0d5a3f45cb tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:58:47.659874 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-b7493f1c-db24-421e-b815-8a0d5a3f45cb tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e" status: 200 len: 1364 microversion: 2.1 time: 0.157814 Sep 16 09:58:47.660440 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 503/1003] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:58:47 2022] GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:58:47.931790 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-24e27398-26f8-4918-a10d-fbe1d063c65b tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Flavor limits 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 09:58:47.932250 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-24e27398-26f8-4918-a10d-fbe1d063c65b tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Image limits 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 09:58:47.932728 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-24e27398-26f8-4918-a10d-fbe1d063c65b tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Flavor pref 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 09:58:47.933143 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-24e27398-26f8-4918-a10d-fbe1d063c65b tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Image pref 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 09:58:47.933583 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-24e27398-26f8-4918-a10d-fbe1d063c65b tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 09:58:47.942690 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-24e27398-26f8-4918-a10d-fbe1d063c65b tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:47.943176 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-24e27398-26f8-4918-a10d-fbe1d063c65b tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:47.943617 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-24e27398-26f8-4918-a10d-fbe1d063c65b tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:47.944343 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-24e27398-26f8-4918-a10d-fbe1d063c65b tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:47.944803 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-24e27398-26f8-4918-a10d-fbe1d063c65b tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:47.945231 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-24e27398-26f8-4918-a10d-fbe1d063c65b tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:47.962408 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-24e27398-26f8-4918-a10d-fbe1d063c65b tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Getting quotas for project 92e292a400454c93a48aca5510bfcee9. Resources: {'instances', 'cores', 'ram'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 09:58:47.966380 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-24e27398-26f8-4918-a10d-fbe1d063c65b tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Getting quotas for user ff870e07952c4e049e17a096c477165b and project 92e292a400454c93a48aca5510bfcee9. Resources: {'instances', 'cores', 'ram'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 09:58:48.022722 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-24e27398-26f8-4918-a10d-fbe1d063c65b tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Going to run 1 instances... {{(pid=127670) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 09:58:48.024893 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-24e27398-26f8-4918-a10d-fbe1d063c65b tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='75a75e17-bd3c-4f46-98b3-f47ceff621bb',volume_size=None,volume_type=None)] {{(pid=127670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 09:58:48.381713 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-24e27398-26f8-4918-a10d-fbe1d063c65b tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.944206 Sep 16 09:58:48.382635 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 501/1004] 10.222.0.73 () {60 vars in 1147 bytes} [Fri Sep 16 09:58:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 946 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 09:58:48.393734 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-25ff943e-6f6f-4e3b-939a-e5a465f8b9af tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:58:48.394727 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-25ff943e-6f6f-4e3b-939a-e5a465f8b9af tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:58:48.451056 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-25ff943e-6f6f-4e3b-939a-e5a465f8b9af tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff870e07952c4e049e17a096c477165b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e292a400454c93a48aca5510bfcee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:58:48.458761 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-25ff943e-6f6f-4e3b-939a-e5a465f8b9af tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25" status: 200 len: 1088 microversion: 2.1 time: 0.069057 Sep 16 09:58:48.459924 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 504/1005] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:58:48 2022] GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25 => generated 1088 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:58:48.684674 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-86b3c598-579d-48e8-93ab-5f0435675201 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:58:48.685461 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-86b3c598-579d-48e8-93ab-5f0435675201 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:58:48.692747 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-86b3c598-579d-48e8-93ab-5f0435675201 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:48.693244 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-86b3c598-579d-48e8-93ab-5f0435675201 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:48.693909 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-86b3c598-579d-48e8-93ab-5f0435675201 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:48.694620 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-86b3c598-579d-48e8-93ab-5f0435675201 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:48.695081 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-86b3c598-579d-48e8-93ab-5f0435675201 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:48.695512 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-86b3c598-579d-48e8-93ab-5f0435675201 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:48.833272 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-86b3c598-579d-48e8-93ab-5f0435675201 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:58:48.840906 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-86b3c598-579d-48e8-93ab-5f0435675201 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e" status: 200 len: 1364 microversion: 2.1 time: 0.160697 Sep 16 09:58:48.842208 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 502/1006] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:58:48 2022] GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:58:49.482291 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-ed970f75-2d26-4b50-bf65-17bb647c7bf9 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:58:49.482933 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-ed970f75-2d26-4b50-bf65-17bb647c7bf9 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:58:49.485227 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell0:SELECT=2 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:58:49.490730 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ed970f75-2d26-4b50-bf65-17bb647c7bf9 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:49.491216 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ed970f75-2d26-4b50-bf65-17bb647c7bf9 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:49.491653 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ed970f75-2d26-4b50-bf65-17bb647c7bf9 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:49.492339 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ed970f75-2d26-4b50-bf65-17bb647c7bf9 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:49.492795 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ed970f75-2d26-4b50-bf65-17bb647c7bf9 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:49.493214 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ed970f75-2d26-4b50-bf65-17bb647c7bf9 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:49.553520 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-ed970f75-2d26-4b50-bf65-17bb647c7bf9 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff870e07952c4e049e17a096c477165b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e292a400454c93a48aca5510bfcee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:58:49.561849 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-ed970f75-2d26-4b50-bf65-17bb647c7bf9 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25" status: 200 len: 1138 microversion: 2.1 time: 0.083552 Sep 16 09:58:49.562406 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 505/1007] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:58:49 2022] GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25 => generated 1138 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:58:49.866238 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-1a6aab7f-241c-4ccb-8b83-b3b0bd7a3c3c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:58:49.866863 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-1a6aab7f-241c-4ccb-8b83-b3b0bd7a3c3c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:58:49.874947 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1a6aab7f-241c-4ccb-8b83-b3b0bd7a3c3c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:49.875444 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1a6aab7f-241c-4ccb-8b83-b3b0bd7a3c3c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:49.875921 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1a6aab7f-241c-4ccb-8b83-b3b0bd7a3c3c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:49.876667 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1a6aab7f-241c-4ccb-8b83-b3b0bd7a3c3c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:49.877155 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1a6aab7f-241c-4ccb-8b83-b3b0bd7a3c3c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:49.877616 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1a6aab7f-241c-4ccb-8b83-b3b0bd7a3c3c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:50.019523 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-1a6aab7f-241c-4ccb-8b83-b3b0bd7a3c3c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:58:50.027333 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-1a6aab7f-241c-4ccb-8b83-b3b0bd7a3c3c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e" status: 200 len: 1364 microversion: 2.1 time: 0.165391 Sep 16 09:58:50.027900 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 503/1008] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:58:49 2022] GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:58:50.522383 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [req-9b37108b-de72-4549-8e96-d345199bca39 req-206cc71d-bc8f-45d3-95f9-584225eadbbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34302fd9-9a71-41c1-8392-6b9df5f0f75e", "name": "network-vif-plugged", "status": "completed", "tag": "d847971e-055c-4ba7-88f6-3092159ade62"}]} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:58:50.534009 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-9b37108b-de72-4549-8e96-d345199bca39 req-206cc71d-bc8f-45d3-95f9-584225eadbbf service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:50.538117 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-9b37108b-de72-4549-8e96-d345199bca39 req-206cc71d-bc8f-45d3-95f9-584225eadbbf service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:50.538117 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-9b37108b-de72-4549-8e96-d345199bca39 req-206cc71d-bc8f-45d3-95f9-584225eadbbf service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:50.546717 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.compute.server_external_events [req-9b37108b-de72-4549-8e96-d345199bca39 req-206cc71d-bc8f-45d3-95f9-584225eadbbf service nova] Creating event network-vif-plugged:d847971e-055c-4ba7-88f6-3092159ade62 for instance 34302fd9-9a71-41c1-8392-6b9df5f0f75e on hv-cinder-79053 Sep 16 09:58:50.551773 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [req-9b37108b-de72-4549-8e96-d345199bca39 req-206cc71d-bc8f-45d3-95f9-584225eadbbf service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033159 Sep 16 09:58:50.552334 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 506/1009] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:58:50.586233 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-10070fdd-e03b-4952-8ecd-ab572d6ea828 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:58:50.586860 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-10070fdd-e03b-4952-8ecd-ab572d6ea828 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:58:50.593478 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-10070fdd-e03b-4952-8ecd-ab572d6ea828 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:50.598447 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-10070fdd-e03b-4952-8ecd-ab572d6ea828 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:50.598447 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-10070fdd-e03b-4952-8ecd-ab572d6ea828 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:50.598447 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-10070fdd-e03b-4952-8ecd-ab572d6ea828 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:50.598447 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-10070fdd-e03b-4952-8ecd-ab572d6ea828 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:50.598850 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-10070fdd-e03b-4952-8ecd-ab572d6ea828 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:50.668914 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-10070fdd-e03b-4952-8ecd-ab572d6ea828 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff870e07952c4e049e17a096c477165b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e292a400454c93a48aca5510bfcee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:58:50.678597 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-10070fdd-e03b-4952-8ecd-ab572d6ea828 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25" status: 200 len: 1186 microversion: 2.1 time: 0.096209 Sep 16 09:58:50.684603 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 504/1010] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:58:50 2022] GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25 => generated 1186 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:58:51.050928 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-2f016f9b-06fd-47cf-9981-5916c644ec12 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:58:51.051653 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-2f016f9b-06fd-47cf-9981-5916c644ec12 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:58:51.058209 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2f016f9b-06fd-47cf-9981-5916c644ec12 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:51.058699 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2f016f9b-06fd-47cf-9981-5916c644ec12 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:51.059132 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2f016f9b-06fd-47cf-9981-5916c644ec12 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:51.059832 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2f016f9b-06fd-47cf-9981-5916c644ec12 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:51.060287 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2f016f9b-06fd-47cf-9981-5916c644ec12 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:51.061276 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2f016f9b-06fd-47cf-9981-5916c644ec12 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:51.204066 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-2f016f9b-06fd-47cf-9981-5916c644ec12 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:58:51.211823 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-2f016f9b-06fd-47cf-9981-5916c644ec12 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e" status: 200 len: 1364 microversion: 2.1 time: 0.165143 Sep 16 09:58:51.212433 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 507/1011] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:58:51 2022] GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:58:51.701792 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-b5bbeb73-31f7-4b72-ab00-9b0602795652 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:58:51.703019 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-b5bbeb73-31f7-4b72-ab00-9b0602795652 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:58:51.709522 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b5bbeb73-31f7-4b72-ab00-9b0602795652 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:51.710043 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b5bbeb73-31f7-4b72-ab00-9b0602795652 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:51.710484 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b5bbeb73-31f7-4b72-ab00-9b0602795652 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:51.711190 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b5bbeb73-31f7-4b72-ab00-9b0602795652 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:51.711650 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b5bbeb73-31f7-4b72-ab00-9b0602795652 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:51.712095 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b5bbeb73-31f7-4b72-ab00-9b0602795652 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:51.781630 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-b5bbeb73-31f7-4b72-ab00-9b0602795652 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff870e07952c4e049e17a096c477165b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e292a400454c93a48aca5510bfcee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:58:51.789258 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-b5bbeb73-31f7-4b72-ab00-9b0602795652 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25" status: 200 len: 1204 microversion: 2.1 time: 0.091669 Sep 16 09:58:51.789874 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 505/1012] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:58:51 2022] GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25 => generated 1204 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:58:52.236190 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-7f979b29-1cac-4597-9c37-aeb0b1d752ea tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:58:52.236807 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-7f979b29-1cac-4597-9c37-aeb0b1d752ea tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:58:52.243288 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7f979b29-1cac-4597-9c37-aeb0b1d752ea tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:52.243776 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7f979b29-1cac-4597-9c37-aeb0b1d752ea tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:52.244218 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7f979b29-1cac-4597-9c37-aeb0b1d752ea tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:52.244913 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7f979b29-1cac-4597-9c37-aeb0b1d752ea tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:52.245373 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7f979b29-1cac-4597-9c37-aeb0b1d752ea tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:52.245887 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-7f979b29-1cac-4597-9c37-aeb0b1d752ea tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:52.381745 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-7f979b29-1cac-4597-9c37-aeb0b1d752ea tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:58:52.390855 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-7f979b29-1cac-4597-9c37-aeb0b1d752ea tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e" status: 200 len: 1364 microversion: 2.1 time: 0.158921 Sep 16 09:58:52.391439 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 508/1013] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:58:52 2022] GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:58:52.813644 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-bb9a0c65-f435-47ff-aad9-24773444f52c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:58:52.814277 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-bb9a0c65-f435-47ff-aad9-24773444f52c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:58:52.820754 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bb9a0c65-f435-47ff-aad9-24773444f52c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:52.823202 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bb9a0c65-f435-47ff-aad9-24773444f52c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:52.823202 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bb9a0c65-f435-47ff-aad9-24773444f52c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:52.823202 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bb9a0c65-f435-47ff-aad9-24773444f52c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:52.823202 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bb9a0c65-f435-47ff-aad9-24773444f52c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:52.823728 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bb9a0c65-f435-47ff-aad9-24773444f52c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:52.905301 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [req-02ad618b-1b8b-4b6a-8dcf-dd1152d41c30 req-ebe3c937-3a67-4cdf-9533-44c0322a793d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70372e0b-76cc-4156-84ae-3734dd9f7b25", "tag": "cc7b6bd5-7e7c-4cc5-8097-75cfcd4c3ad8"}]} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:58:52.915247 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-02ad618b-1b8b-4b6a-8dcf-dd1152d41c30 req-ebe3c937-3a67-4cdf-9533-44c0322a793d service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:52.915830 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-02ad618b-1b8b-4b6a-8dcf-dd1152d41c30 req-ebe3c937-3a67-4cdf-9533-44c0322a793d service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:52.916258 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-02ad618b-1b8b-4b6a-8dcf-dd1152d41c30 req-ebe3c937-3a67-4cdf-9533-44c0322a793d service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:52.928064 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.compute.server_external_events [req-02ad618b-1b8b-4b6a-8dcf-dd1152d41c30 req-ebe3c937-3a67-4cdf-9533-44c0322a793d service nova] Creating event network-changed:cc7b6bd5-7e7c-4cc5-8097-75cfcd4c3ad8 for instance 70372e0b-76cc-4156-84ae-3734dd9f7b25 on hv-cinder-79053 Sep 16 09:58:52.932913 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [req-02ad618b-1b8b-4b6a-8dcf-dd1152d41c30 req-ebe3c937-3a67-4cdf-9533-44c0322a793d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031434 Sep 16 09:58:52.933677 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 509/1014] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 09:58:53.055516 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-bb9a0c65-f435-47ff-aad9-24773444f52c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff870e07952c4e049e17a096c477165b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e292a400454c93a48aca5510bfcee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:58:53.063618 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-bb9a0c65-f435-47ff-aad9-24773444f52c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25" status: 200 len: 1259 microversion: 2.1 time: 0.254795 Sep 16 09:58:53.064200 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 506/1015] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:58:52 2022] GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25 => generated 1259 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:58:53.415056 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-c7faa9a9-30bc-470d-9d3f-abc3c99fa9ab tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:58:53.415764 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-c7faa9a9-30bc-470d-9d3f-abc3c99fa9ab tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:58:53.422860 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c7faa9a9-30bc-470d-9d3f-abc3c99fa9ab tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:53.423354 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c7faa9a9-30bc-470d-9d3f-abc3c99fa9ab tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:53.423800 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c7faa9a9-30bc-470d-9d3f-abc3c99fa9ab tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:53.424670 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c7faa9a9-30bc-470d-9d3f-abc3c99fa9ab tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:53.425137 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c7faa9a9-30bc-470d-9d3f-abc3c99fa9ab tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:53.425601 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c7faa9a9-30bc-470d-9d3f-abc3c99fa9ab tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:53.568938 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-c7faa9a9-30bc-470d-9d3f-abc3c99fa9ab tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:58:53.577066 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-c7faa9a9-30bc-470d-9d3f-abc3c99fa9ab tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e" status: 200 len: 1550 microversion: 2.1 time: 0.166630 Sep 16 09:58:53.577679 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 510/1016] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:58:53 2022] GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e => generated 1550 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:58:53.599465 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-73dafec7-4abd-4505-856e-89ae524dad56 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:58:53.600227 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-73dafec7-4abd-4505-856e-89ae524dad56 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:58:53.606135 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-73dafec7-4abd-4505-856e-89ae524dad56 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:53.606619 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-73dafec7-4abd-4505-856e-89ae524dad56 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:53.607054 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-73dafec7-4abd-4505-856e-89ae524dad56 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:53.608339 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-73dafec7-4abd-4505-856e-89ae524dad56 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:53.608948 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-73dafec7-4abd-4505-856e-89ae524dad56 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:53.609375 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-73dafec7-4abd-4505-856e-89ae524dad56 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:53.689121 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-73dafec7-4abd-4505-856e-89ae524dad56 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093555 Sep 16 09:58:53.689751 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 507/1017] 10.222.0.73 () {58 vars in 1275 bytes} [Fri Sep 16 09:58:53 2022] GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:58:54.090637 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-cfbee425-484e-4b43-88ab-4a9f7220203a tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:58:54.091259 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-cfbee425-484e-4b43-88ab-4a9f7220203a tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:58:54.098662 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-cfbee425-484e-4b43-88ab-4a9f7220203a tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:54.099161 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-cfbee425-484e-4b43-88ab-4a9f7220203a tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:54.099857 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-cfbee425-484e-4b43-88ab-4a9f7220203a tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:54.100574 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-cfbee425-484e-4b43-88ab-4a9f7220203a tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:54.101033 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-cfbee425-484e-4b43-88ab-4a9f7220203a tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:54.101462 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-cfbee425-484e-4b43-88ab-4a9f7220203a tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:54.243650 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-cfbee425-484e-4b43-88ab-4a9f7220203a tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff870e07952c4e049e17a096c477165b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e292a400454c93a48aca5510bfcee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:58:54.252307 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-cfbee425-484e-4b43-88ab-4a9f7220203a tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25" status: 200 len: 1259 microversion: 2.1 time: 0.165458 Sep 16 09:58:54.253108 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 511/1018] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:58:54 2022] GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25 => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:58:54.948850 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-b1a097ac-7849-4a9b-a567-80a3cddafe31 req-d66841d0-9bce-4824-bd72-93bda76658a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34302fd9-9a71-41c1-8392-6b9df5f0f75e", "tag": "d847971e-055c-4ba7-88f6-3092159ade62"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:58:54.958633 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-b1a097ac-7849-4a9b-a567-80a3cddafe31 req-d66841d0-9bce-4824-bd72-93bda76658a9 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:54.959121 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-b1a097ac-7849-4a9b-a567-80a3cddafe31 req-d66841d0-9bce-4824-bd72-93bda76658a9 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:54.959563 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-b1a097ac-7849-4a9b-a567-80a3cddafe31 req-d66841d0-9bce-4824-bd72-93bda76658a9 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:54.970847 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-b1a097ac-7849-4a9b-a567-80a3cddafe31 req-d66841d0-9bce-4824-bd72-93bda76658a9 service nova] Creating event network-changed:d847971e-055c-4ba7-88f6-3092159ade62 for instance 34302fd9-9a71-41c1-8392-6b9df5f0f75e on hv-cinder-79053 Sep 16 09:58:54.976148 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-b1a097ac-7849-4a9b-a567-80a3cddafe31 req-d66841d0-9bce-4824-bd72-93bda76658a9 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031489 Sep 16 09:58:54.976808 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 508/1019] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:58:55.275951 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-a9d9a189-d82e-4ce7-8c6d-bf2df9227b22 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:58:55.283628 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-a9d9a189-d82e-4ce7-8c6d-bf2df9227b22 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:58:55.284184 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a9d9a189-d82e-4ce7-8c6d-bf2df9227b22 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:55.284679 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a9d9a189-d82e-4ce7-8c6d-bf2df9227b22 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:55.285117 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a9d9a189-d82e-4ce7-8c6d-bf2df9227b22 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:55.285862 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a9d9a189-d82e-4ce7-8c6d-bf2df9227b22 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:55.286306 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a9d9a189-d82e-4ce7-8c6d-bf2df9227b22 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:55.286733 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a9d9a189-d82e-4ce7-8c6d-bf2df9227b22 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:55.428417 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-a9d9a189-d82e-4ce7-8c6d-bf2df9227b22 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff870e07952c4e049e17a096c477165b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e292a400454c93a48aca5510bfcee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:58:55.436655 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-a9d9a189-d82e-4ce7-8c6d-bf2df9227b22 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25" status: 200 len: 1259 microversion: 2.1 time: 0.164511 Sep 16 09:58:55.437242 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 512/1020] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:58:55 2022] GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25 => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:58:56.464444 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-fad0599b-07c7-410c-a734-3e4f787c25a6 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:58:56.465189 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-fad0599b-07c7-410c-a734-3e4f787c25a6 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:58:56.472700 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fad0599b-07c7-410c-a734-3e4f787c25a6 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:56.473191 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fad0599b-07c7-410c-a734-3e4f787c25a6 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:56.473674 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fad0599b-07c7-410c-a734-3e4f787c25a6 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:56.474378 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fad0599b-07c7-410c-a734-3e4f787c25a6 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:56.475117 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fad0599b-07c7-410c-a734-3e4f787c25a6 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:56.475552 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fad0599b-07c7-410c-a734-3e4f787c25a6 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:56.607241 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-fad0599b-07c7-410c-a734-3e4f787c25a6 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff870e07952c4e049e17a096c477165b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e292a400454c93a48aca5510bfcee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:58:56.615042 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-fad0599b-07c7-410c-a734-3e4f787c25a6 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25" status: 200 len: 1259 microversion: 2.1 time: 0.155400 Sep 16 09:58:56.615606 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 509/1021] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:58:56 2022] GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 09:58:57.636335 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-286d9b50-79e8-43e4-ad08-a12d2d909e54 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:58:57.636951 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-286d9b50-79e8-43e4-ad08-a12d2d909e54 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:58:57.644061 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-286d9b50-79e8-43e4-ad08-a12d2d909e54 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:57.644546 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-286d9b50-79e8-43e4-ad08-a12d2d909e54 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:57.645150 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-286d9b50-79e8-43e4-ad08-a12d2d909e54 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:57.646007 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-286d9b50-79e8-43e4-ad08-a12d2d909e54 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:57.646575 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-286d9b50-79e8-43e4-ad08-a12d2d909e54 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:57.647066 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-286d9b50-79e8-43e4-ad08-a12d2d909e54 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:57.778996 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-286d9b50-79e8-43e4-ad08-a12d2d909e54 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff870e07952c4e049e17a096c477165b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e292a400454c93a48aca5510bfcee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:58:57.787354 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-286d9b50-79e8-43e4-ad08-a12d2d909e54 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25" status: 200 len: 1259 microversion: 2.1 time: 0.154979 Sep 16 09:58:57.787918 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 513/1022] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:58:57 2022] GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:58:58.811030 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-3344a5c6-1170-4ad6-a75f-d0920823765b tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:58:58.812291 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-3344a5c6-1170-4ad6-a75f-d0920823765b tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:58:58.814875 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell0:SELECT=2 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:58:58.815546 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell0:SELECT=12 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:58:58.820226 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3344a5c6-1170-4ad6-a75f-d0920823765b tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:58.820756 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3344a5c6-1170-4ad6-a75f-d0920823765b tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:58.821192 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3344a5c6-1170-4ad6-a75f-d0920823765b tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:58.821903 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3344a5c6-1170-4ad6-a75f-d0920823765b tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:58.822358 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3344a5c6-1170-4ad6-a75f-d0920823765b tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:58.822781 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-3344a5c6-1170-4ad6-a75f-d0920823765b tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:58.959629 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-3344a5c6-1170-4ad6-a75f-d0920823765b tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff870e07952c4e049e17a096c477165b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e292a400454c93a48aca5510bfcee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:58:58.967160 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-3344a5c6-1170-4ad6-a75f-d0920823765b tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25" status: 200 len: 1259 microversion: 2.1 time: 0.160282 Sep 16 09:58:58.968266 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 510/1023] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:58:58 2022] GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:58:59.990327 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-1a9f3d1f-4856-43d2-98ab-4b622e4c9b7c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:58:59.990934 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-1a9f3d1f-4856-43d2-98ab-4b622e4c9b7c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:58:59.992859 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell0:SELECT=8 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:58:59.998036 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1a9f3d1f-4856-43d2-98ab-4b622e4c9b7c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:58:59.998519 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1a9f3d1f-4856-43d2-98ab-4b622e4c9b7c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:58:59.998955 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1a9f3d1f-4856-43d2-98ab-4b622e4c9b7c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:58:59.999653 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1a9f3d1f-4856-43d2-98ab-4b622e4c9b7c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:59:00.000108 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1a9f3d1f-4856-43d2-98ab-4b622e4c9b7c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:59:00.000579 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1a9f3d1f-4856-43d2-98ab-4b622e4c9b7c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:59:00.131317 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-1a9f3d1f-4856-43d2-98ab-4b622e4c9b7c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff870e07952c4e049e17a096c477165b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e292a400454c93a48aca5510bfcee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:59:00.138910 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-1a9f3d1f-4856-43d2-98ab-4b622e4c9b7c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25" status: 200 len: 1259 microversion: 2.1 time: 0.152492 Sep 16 09:59:00.139464 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 514/1024] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:58:59 2022] GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:59:01.162268 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d0d5394e-a003-48a8-b6da-ac0cf9c0bb70 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:59:01.162892 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-d0d5394e-a003-48a8-b6da-ac0cf9c0bb70 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:59:01.169291 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d0d5394e-a003-48a8-b6da-ac0cf9c0bb70 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:59:01.169822 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d0d5394e-a003-48a8-b6da-ac0cf9c0bb70 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:59:01.170266 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d0d5394e-a003-48a8-b6da-ac0cf9c0bb70 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:59:01.170964 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d0d5394e-a003-48a8-b6da-ac0cf9c0bb70 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:59:01.171436 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d0d5394e-a003-48a8-b6da-ac0cf9c0bb70 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:59:01.171870 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d0d5394e-a003-48a8-b6da-ac0cf9c0bb70 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:59:01.304287 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-d0d5394e-a003-48a8-b6da-ac0cf9c0bb70 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff870e07952c4e049e17a096c477165b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e292a400454c93a48aca5510bfcee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:59:01.312040 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-d0d5394e-a003-48a8-b6da-ac0cf9c0bb70 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25" status: 200 len: 1259 microversion: 2.1 time: 0.153660 Sep 16 09:59:01.317691 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 511/1025] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:59:01 2022] GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:59:02.335127 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-43d809d8-7dd9-4409-8a23-8376e07b5a6c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:59:02.335684 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-43d809d8-7dd9-4409-8a23-8376e07b5a6c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:59:02.341932 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-43d809d8-7dd9-4409-8a23-8376e07b5a6c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:59:02.342422 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-43d809d8-7dd9-4409-8a23-8376e07b5a6c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:59:02.342997 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-43d809d8-7dd9-4409-8a23-8376e07b5a6c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:59:02.343693 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-43d809d8-7dd9-4409-8a23-8376e07b5a6c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:59:02.344942 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-43d809d8-7dd9-4409-8a23-8376e07b5a6c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:59:02.345312 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-43d809d8-7dd9-4409-8a23-8376e07b5a6c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:59:02.477497 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-43d809d8-7dd9-4409-8a23-8376e07b5a6c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff870e07952c4e049e17a096c477165b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e292a400454c93a48aca5510bfcee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:59:02.485694 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-43d809d8-7dd9-4409-8a23-8376e07b5a6c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25" status: 200 len: 1259 microversion: 2.1 time: 0.154123 Sep 16 09:59:02.486299 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 515/1026] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:59:02 2022] GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:59:03.508362 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-046e6fb9-4a4c-4bc4-bc13-0db38e9a5c61 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:59:03.508992 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-046e6fb9-4a4c-4bc4-bc13-0db38e9a5c61 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:59:03.515149 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-046e6fb9-4a4c-4bc4-bc13-0db38e9a5c61 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:59:03.515636 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-046e6fb9-4a4c-4bc4-bc13-0db38e9a5c61 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:59:03.516719 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-046e6fb9-4a4c-4bc4-bc13-0db38e9a5c61 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:59:03.517414 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-046e6fb9-4a4c-4bc4-bc13-0db38e9a5c61 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:59:03.517897 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-046e6fb9-4a4c-4bc4-bc13-0db38e9a5c61 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:59:03.518326 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-046e6fb9-4a4c-4bc4-bc13-0db38e9a5c61 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:59:03.649421 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-046e6fb9-4a4c-4bc4-bc13-0db38e9a5c61 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff870e07952c4e049e17a096c477165b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e292a400454c93a48aca5510bfcee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:59:03.657004 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-046e6fb9-4a4c-4bc4-bc13-0db38e9a5c61 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25" status: 200 len: 1259 microversion: 2.1 time: 0.152589 Sep 16 09:59:03.657704 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 512/1027] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:59:03 2022] GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:59:04.505528 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [req-cb2391e3-1415-4a7a-b9e6-b6f4fd916c3f req-dbd2b22d-d011-4733-bbb8-9b9e17796d4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70372e0b-76cc-4156-84ae-3734dd9f7b25", "name": "network-vif-plugged", "status": "completed", "tag": "cc7b6bd5-7e7c-4cc5-8097-75cfcd4c3ad8"}]} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:59:04.515651 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-cb2391e3-1415-4a7a-b9e6-b6f4fd916c3f req-dbd2b22d-d011-4733-bbb8-9b9e17796d4f service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:59:04.516756 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-cb2391e3-1415-4a7a-b9e6-b6f4fd916c3f req-dbd2b22d-d011-4733-bbb8-9b9e17796d4f service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:59:04.517309 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-cb2391e3-1415-4a7a-b9e6-b6f4fd916c3f req-dbd2b22d-d011-4733-bbb8-9b9e17796d4f service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:59:04.530434 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.compute.server_external_events [req-cb2391e3-1415-4a7a-b9e6-b6f4fd916c3f req-dbd2b22d-d011-4733-bbb8-9b9e17796d4f service nova] Creating event network-vif-plugged:cc7b6bd5-7e7c-4cc5-8097-75cfcd4c3ad8 for instance 70372e0b-76cc-4156-84ae-3734dd9f7b25 on hv-cinder-79053 Sep 16 09:59:04.541051 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [req-cb2391e3-1415-4a7a-b9e6-b6f4fd916c3f req-dbd2b22d-d011-4733-bbb8-9b9e17796d4f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035234 Sep 16 09:59:04.541051 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 516/1028] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:59:04.679515 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-9c049a61-0cc4-43dc-8f0a-dd5bdbf5455b tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:59:04.680400 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-9c049a61-0cc4-43dc-8f0a-dd5bdbf5455b tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:59:04.687095 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9c049a61-0cc4-43dc-8f0a-dd5bdbf5455b tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:59:04.687589 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9c049a61-0cc4-43dc-8f0a-dd5bdbf5455b tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:59:04.688084 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9c049a61-0cc4-43dc-8f0a-dd5bdbf5455b tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:59:04.688794 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9c049a61-0cc4-43dc-8f0a-dd5bdbf5455b tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:59:04.689255 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9c049a61-0cc4-43dc-8f0a-dd5bdbf5455b tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:59:04.689730 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9c049a61-0cc4-43dc-8f0a-dd5bdbf5455b tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:59:04.825060 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-9c049a61-0cc4-43dc-8f0a-dd5bdbf5455b tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff870e07952c4e049e17a096c477165b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e292a400454c93a48aca5510bfcee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:59:04.833651 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-9c049a61-0cc4-43dc-8f0a-dd5bdbf5455b tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25" status: 200 len: 1259 microversion: 2.1 time: 0.158002 Sep 16 09:59:04.834668 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 513/1029] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:59:04 2022] GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:59:05.858269 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-830d35a5-0268-4bc9-84cd-cb0f5dbda9a6 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:59:05.858972 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-830d35a5-0268-4bc9-84cd-cb0f5dbda9a6 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:59:05.866043 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-830d35a5-0268-4bc9-84cd-cb0f5dbda9a6 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:59:05.866532 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-830d35a5-0268-4bc9-84cd-cb0f5dbda9a6 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:59:05.867004 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-830d35a5-0268-4bc9-84cd-cb0f5dbda9a6 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:59:05.867697 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-830d35a5-0268-4bc9-84cd-cb0f5dbda9a6 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:59:05.868155 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-830d35a5-0268-4bc9-84cd-cb0f5dbda9a6 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:59:05.868581 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-830d35a5-0268-4bc9-84cd-cb0f5dbda9a6 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:59:06.002036 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-830d35a5-0268-4bc9-84cd-cb0f5dbda9a6 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff870e07952c4e049e17a096c477165b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e292a400454c93a48aca5510bfcee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:59:06.009676 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-830d35a5-0268-4bc9-84cd-cb0f5dbda9a6 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25" status: 200 len: 1259 microversion: 2.1 time: 0.156168 Sep 16 09:59:06.010241 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 517/1030] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:59:05 2022] GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:59:07.032283 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-a3c4b3ac-bf28-49b5-90aa-addaf914c6d9 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:59:07.033109 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-a3c4b3ac-bf28-49b5-90aa-addaf914c6d9 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:59:07.039445 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a3c4b3ac-bf28-49b5-90aa-addaf914c6d9 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:59:07.039934 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a3c4b3ac-bf28-49b5-90aa-addaf914c6d9 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:59:07.040371 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a3c4b3ac-bf28-49b5-90aa-addaf914c6d9 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:59:07.041065 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a3c4b3ac-bf28-49b5-90aa-addaf914c6d9 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:59:07.041525 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a3c4b3ac-bf28-49b5-90aa-addaf914c6d9 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:59:07.041976 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a3c4b3ac-bf28-49b5-90aa-addaf914c6d9 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:59:07.174374 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-a3c4b3ac-bf28-49b5-90aa-addaf914c6d9 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff870e07952c4e049e17a096c477165b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e292a400454c93a48aca5510bfcee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:59:07.182076 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-a3c4b3ac-bf28-49b5-90aa-addaf914c6d9 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25" status: 200 len: 1444 microversion: 2.1 time: 0.153712 Sep 16 09:59:07.182643 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 514/1031] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:59:07 2022] GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25 => generated 1444 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:59:07.203795 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-56c8a43a-61ad-43fb-875f-227f4aecfdfe tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:59:07.204724 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-56c8a43a-61ad-43fb-875f-227f4aecfdfe tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:59:07.211123 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-56c8a43a-61ad-43fb-875f-227f4aecfdfe tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:59:07.211608 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-56c8a43a-61ad-43fb-875f-227f4aecfdfe tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:59:07.212047 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-56c8a43a-61ad-43fb-875f-227f4aecfdfe tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:59:07.212736 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-56c8a43a-61ad-43fb-875f-227f4aecfdfe tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:59:07.213193 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-56c8a43a-61ad-43fb-875f-227f4aecfdfe tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:59:07.213655 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-56c8a43a-61ad-43fb-875f-227f4aecfdfe tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:59:07.217968 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell1:SELECT=100 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:59:07.347908 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-56c8a43a-61ad-43fb-875f-227f4aecfdfe tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff870e07952c4e049e17a096c477165b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e292a400454c93a48aca5510bfcee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:59:07.355890 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-56c8a43a-61ad-43fb-875f-227f4aecfdfe tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25" status: 200 len: 1444 microversion: 2.1 time: 0.155974 Sep 16 09:59:07.356458 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 518/1032] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:59:07 2022] GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25 => generated 1444 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:59:09.618546 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-81c6c9ac-7f51-4050-a218-73db14fbdceb req-709698e9-2d6d-4aa0-a053-6ea3a6f2f83f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70372e0b-76cc-4156-84ae-3734dd9f7b25", "tag": "cc7b6bd5-7e7c-4cc5-8097-75cfcd4c3ad8"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:59:09.623988 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=4 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:59:09.629650 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-81c6c9ac-7f51-4050-a218-73db14fbdceb req-709698e9-2d6d-4aa0-a053-6ea3a6f2f83f service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:59:09.630216 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-81c6c9ac-7f51-4050-a218-73db14fbdceb req-709698e9-2d6d-4aa0-a053-6ea3a6f2f83f service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:59:09.630725 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-81c6c9ac-7f51-4050-a218-73db14fbdceb req-709698e9-2d6d-4aa0-a053-6ea3a6f2f83f service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:59:09.634496 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=89 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:59:09.642604 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-81c6c9ac-7f51-4050-a218-73db14fbdceb req-709698e9-2d6d-4aa0-a053-6ea3a6f2f83f service nova] Creating event network-changed:cc7b6bd5-7e7c-4cc5-8097-75cfcd4c3ad8 for instance 70372e0b-76cc-4156-84ae-3734dd9f7b25 on hv-cinder-79053 Sep 16 09:59:09.647983 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-81c6c9ac-7f51-4050-a218-73db14fbdceb req-709698e9-2d6d-4aa0-a053-6ea3a6f2f83f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032967 Sep 16 09:59:09.648585 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 515/1033] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 09:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:59:31.171896 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-735e3fbe-39ff-4b7a-9294-1e1fa48d94c2 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:59:31.172404 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-735e3fbe-39ff-4b7a-9294-1e1fa48d94c2 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:59:31.174909 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:59:31.175651 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell1:SELECT=4 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 09:59:31.180381 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-735e3fbe-39ff-4b7a-9294-1e1fa48d94c2 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:59:31.184240 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-735e3fbe-39ff-4b7a-9294-1e1fa48d94c2 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:59:31.184240 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-735e3fbe-39ff-4b7a-9294-1e1fa48d94c2 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:59:31.184240 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-735e3fbe-39ff-4b7a-9294-1e1fa48d94c2 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:59:31.184240 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-735e3fbe-39ff-4b7a-9294-1e1fa48d94c2 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:59:31.184685 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-735e3fbe-39ff-4b7a-9294-1e1fa48d94c2 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:59:31.207412 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-735e3fbe-39ff-4b7a-9294-1e1fa48d94c2 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e/ips" status: 200 len: 145 microversion: 2.1 time: 0.039429 Sep 16 09:59:31.207982 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 519/1034] 10.222.0.73 () {58 vars in 1248 bytes} [Fri Sep 16 09:59:31 2022] GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e/ips => generated 145 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:59:33.532190 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-bf6ca57b-6d07-44e8-95db-7e4caf247496 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eafcfb1c-0d8e-4efb-8bc1-d35f61f97b5c"}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:59:33.534993 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-bf6ca57b-6d07-44e8-95db-7e4caf247496 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:59:33.542172 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bf6ca57b-6d07-44e8-95db-7e4caf247496 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:59:33.542666 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bf6ca57b-6d07-44e8-95db-7e4caf247496 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:59:33.543115 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bf6ca57b-6d07-44e8-95db-7e4caf247496 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:59:33.543813 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bf6ca57b-6d07-44e8-95db-7e4caf247496 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:59:33.544352 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bf6ca57b-6d07-44e8-95db-7e4caf247496 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:59:33.544787 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bf6ca57b-6d07-44e8-95db-7e4caf247496 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:59:34.109043 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-bf6ca57b-6d07-44e8-95db-7e4caf247496 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "POST /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.582487 Sep 16 09:59:34.109687 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 516/1035] 10.222.0.73 () {60 vars in 1323 bytes} [Fri Sep 16 09:59:33 2022] POST /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e/os-volume_attachments => generated 194 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 09:59:41.646742 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-0733ba38-ce16-42d5-aa5a-7af13b1d9472 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:59:41.653879 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-0733ba38-ce16-42d5-aa5a-7af13b1d9472 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:59:41.654364 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-0733ba38-ce16-42d5-aa5a-7af13b1d9472 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:59:41.654799 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-0733ba38-ce16-42d5-aa5a-7af13b1d9472 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:59:41.714027 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-0733ba38-ce16-42d5-aa5a-7af13b1d9472 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Going to try to stop instance {{(pid=127671) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 16 09:59:41.902013 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-0733ba38-ce16-42d5-aa5a-7af13b1d9472 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "POST /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e/action" status: 202 len: 0 microversion: 2.1 time: 0.259778 Sep 16 09:59:41.902610 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 520/1036] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Sep 16 09:59:41 2022] POST /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 09:59:41.912165 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-479fe48c-8aa5-42b2-95d0-435d90892c75 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:59:41.912877 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-479fe48c-8aa5-42b2-95d0-435d90892c75 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:59:41.919147 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-479fe48c-8aa5-42b2-95d0-435d90892c75 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:59:41.924209 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-479fe48c-8aa5-42b2-95d0-435d90892c75 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:59:41.924209 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-479fe48c-8aa5-42b2-95d0-435d90892c75 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:59:41.924209 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-479fe48c-8aa5-42b2-95d0-435d90892c75 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:59:41.924209 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-479fe48c-8aa5-42b2-95d0-435d90892c75 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:59:41.924606 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-479fe48c-8aa5-42b2-95d0-435d90892c75 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:59:42.053640 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-479fe48c-8aa5-42b2-95d0-435d90892c75 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:59:42.062083 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-479fe48c-8aa5-42b2-95d0-435d90892c75 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e" status: 200 len: 1724 microversion: 2.1 time: 0.155006 Sep 16 09:59:42.062712 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 517/1037] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:59:41 2022] GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:59:43.085305 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-340ae169-b49b-47b1-bd0f-7086be7226aa tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:59:43.086083 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-340ae169-b49b-47b1-bd0f-7086be7226aa tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:59:43.092337 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-340ae169-b49b-47b1-bd0f-7086be7226aa tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:59:43.092828 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-340ae169-b49b-47b1-bd0f-7086be7226aa tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:59:43.093275 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-340ae169-b49b-47b1-bd0f-7086be7226aa tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:59:43.094030 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-340ae169-b49b-47b1-bd0f-7086be7226aa tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:59:43.094498 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-340ae169-b49b-47b1-bd0f-7086be7226aa tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:59:43.094932 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-340ae169-b49b-47b1-bd0f-7086be7226aa tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:59:43.231572 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-340ae169-b49b-47b1-bd0f-7086be7226aa tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:59:43.240320 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-340ae169-b49b-47b1-bd0f-7086be7226aa tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e" status: 200 len: 1724 microversion: 2.1 time: 0.159837 Sep 16 09:59:43.240877 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 521/1038] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:59:43 2022] GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:59:44.262764 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-6b7c4713-a9fa-4c7f-8f05-b995843371ff tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:59:44.263385 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-6b7c4713-a9fa-4c7f-8f05-b995843371ff tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:59:44.271105 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6b7c4713-a9fa-4c7f-8f05-b995843371ff tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:59:44.271600 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6b7c4713-a9fa-4c7f-8f05-b995843371ff tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:59:44.272048 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6b7c4713-a9fa-4c7f-8f05-b995843371ff tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:59:44.272749 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6b7c4713-a9fa-4c7f-8f05-b995843371ff tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:59:44.273217 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6b7c4713-a9fa-4c7f-8f05-b995843371ff tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:59:44.273676 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6b7c4713-a9fa-4c7f-8f05-b995843371ff tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:59:44.405974 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-6b7c4713-a9fa-4c7f-8f05-b995843371ff tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:59:44.415521 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-6b7c4713-a9fa-4c7f-8f05-b995843371ff tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e" status: 200 len: 1724 microversion: 2.1 time: 0.156620 Sep 16 09:59:44.416095 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 518/1039] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:59:44 2022] GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:59:45.438920 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-fc9efd25-247e-4280-88dd-236cee0fd2c0 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:59:45.439456 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-fc9efd25-247e-4280-88dd-236cee0fd2c0 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:59:45.446022 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-fc9efd25-247e-4280-88dd-236cee0fd2c0 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:59:45.446515 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-fc9efd25-247e-4280-88dd-236cee0fd2c0 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:59:45.446959 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-fc9efd25-247e-4280-88dd-236cee0fd2c0 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:59:45.447658 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-fc9efd25-247e-4280-88dd-236cee0fd2c0 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:59:45.448146 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-fc9efd25-247e-4280-88dd-236cee0fd2c0 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:59:45.448580 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-fc9efd25-247e-4280-88dd-236cee0fd2c0 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:59:45.582024 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-fc9efd25-247e-4280-88dd-236cee0fd2c0 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:59:45.590206 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-fc9efd25-247e-4280-88dd-236cee0fd2c0 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e" status: 200 len: 1724 microversion: 2.1 time: 0.155229 Sep 16 09:59:45.590771 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 522/1040] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:59:45 2022] GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:59:46.614368 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-9fdd1046-0ef6-47de-9b05-959d068289d7 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:59:46.614987 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-9fdd1046-0ef6-47de-9b05-959d068289d7 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:59:46.621461 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9fdd1046-0ef6-47de-9b05-959d068289d7 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:59:46.621987 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9fdd1046-0ef6-47de-9b05-959d068289d7 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:59:46.622432 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9fdd1046-0ef6-47de-9b05-959d068289d7 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:59:46.623131 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9fdd1046-0ef6-47de-9b05-959d068289d7 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:59:46.623596 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9fdd1046-0ef6-47de-9b05-959d068289d7 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:59:46.624029 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9fdd1046-0ef6-47de-9b05-959d068289d7 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:59:46.753980 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-9fdd1046-0ef6-47de-9b05-959d068289d7 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:59:46.762247 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-9fdd1046-0ef6-47de-9b05-959d068289d7 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e" status: 200 len: 1724 microversion: 2.1 time: 0.152736 Sep 16 09:59:46.762824 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 519/1041] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:59:46 2022] GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:59:47.785437 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-677fdd0c-f496-4762-9dca-f0e9abb4852d tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:59:47.786011 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-677fdd0c-f496-4762-9dca-f0e9abb4852d tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:59:47.792397 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-677fdd0c-f496-4762-9dca-f0e9abb4852d tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:59:47.792883 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-677fdd0c-f496-4762-9dca-f0e9abb4852d tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:59:47.793321 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-677fdd0c-f496-4762-9dca-f0e9abb4852d tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:59:47.794046 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-677fdd0c-f496-4762-9dca-f0e9abb4852d tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:59:47.794507 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-677fdd0c-f496-4762-9dca-f0e9abb4852d tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:59:47.794937 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-677fdd0c-f496-4762-9dca-f0e9abb4852d tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:59:47.923481 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-677fdd0c-f496-4762-9dca-f0e9abb4852d tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:59:47.931583 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-677fdd0c-f496-4762-9dca-f0e9abb4852d tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e" status: 200 len: 1724 microversion: 2.1 time: 0.150079 Sep 16 09:59:47.932150 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 523/1042] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:59:47 2022] GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:59:48.955083 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-5ddd9b3a-1e3a-46d0-a2e8-bcb2d0ae693c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:59:48.956305 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-5ddd9b3a-1e3a-46d0-a2e8-bcb2d0ae693c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:59:48.962743 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5ddd9b3a-1e3a-46d0-a2e8-bcb2d0ae693c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:59:48.963233 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5ddd9b3a-1e3a-46d0-a2e8-bcb2d0ae693c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:59:48.963751 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5ddd9b3a-1e3a-46d0-a2e8-bcb2d0ae693c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:59:48.964451 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5ddd9b3a-1e3a-46d0-a2e8-bcb2d0ae693c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:59:48.964912 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5ddd9b3a-1e3a-46d0-a2e8-bcb2d0ae693c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:59:48.965341 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-5ddd9b3a-1e3a-46d0-a2e8-bcb2d0ae693c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:59:49.093069 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-5ddd9b3a-1e3a-46d0-a2e8-bcb2d0ae693c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:59:49.102512 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-5ddd9b3a-1e3a-46d0-a2e8-bcb2d0ae693c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e" status: 200 len: 1724 microversion: 2.1 time: 0.151382 Sep 16 09:59:49.103084 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 520/1043] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:59:48 2022] GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:59:50.125993 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-f99ff620-ebce-4a7d-8f2a-b31aa5abfdd0 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:59:50.126612 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-f99ff620-ebce-4a7d-8f2a-b31aa5abfdd0 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:59:50.133306 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f99ff620-ebce-4a7d-8f2a-b31aa5abfdd0 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:59:50.133838 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f99ff620-ebce-4a7d-8f2a-b31aa5abfdd0 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:59:50.134285 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f99ff620-ebce-4a7d-8f2a-b31aa5abfdd0 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:59:50.134984 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f99ff620-ebce-4a7d-8f2a-b31aa5abfdd0 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:59:50.135448 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f99ff620-ebce-4a7d-8f2a-b31aa5abfdd0 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:59:50.135882 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f99ff620-ebce-4a7d-8f2a-b31aa5abfdd0 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:59:50.267289 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-f99ff620-ebce-4a7d-8f2a-b31aa5abfdd0 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:59:50.276186 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-f99ff620-ebce-4a7d-8f2a-b31aa5abfdd0 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e" status: 200 len: 1724 microversion: 2.1 time: 0.154061 Sep 16 09:59:50.276751 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 524/1044] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:59:50 2022] GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:59:51.300550 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-161fd786-cf8f-40aa-ab39-9d36df104fbd tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:59:51.301652 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-161fd786-cf8f-40aa-ab39-9d36df104fbd tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:59:51.308124 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-161fd786-cf8f-40aa-ab39-9d36df104fbd tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:59:51.308619 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-161fd786-cf8f-40aa-ab39-9d36df104fbd tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:59:51.309066 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-161fd786-cf8f-40aa-ab39-9d36df104fbd tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:59:51.309834 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-161fd786-cf8f-40aa-ab39-9d36df104fbd tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:59:51.310326 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-161fd786-cf8f-40aa-ab39-9d36df104fbd tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:59:51.310763 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-161fd786-cf8f-40aa-ab39-9d36df104fbd tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:59:51.440291 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-161fd786-cf8f-40aa-ab39-9d36df104fbd tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:59:51.448599 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-161fd786-cf8f-40aa-ab39-9d36df104fbd tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e" status: 200 len: 1724 microversion: 2.1 time: 0.152366 Sep 16 09:59:51.449242 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 521/1045] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:59:51 2022] GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:59:52.471842 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-ae3427cb-42ae-4061-92a2-b06774e04b50 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:59:52.473193 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-ae3427cb-42ae-4061-92a2-b06774e04b50 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:59:52.480035 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ae3427cb-42ae-4061-92a2-b06774e04b50 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:59:52.480525 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ae3427cb-42ae-4061-92a2-b06774e04b50 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:59:52.480969 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ae3427cb-42ae-4061-92a2-b06774e04b50 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:59:52.481698 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ae3427cb-42ae-4061-92a2-b06774e04b50 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:59:52.482193 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ae3427cb-42ae-4061-92a2-b06774e04b50 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:59:52.482631 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ae3427cb-42ae-4061-92a2-b06774e04b50 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:59:52.608928 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-ae3427cb-42ae-4061-92a2-b06774e04b50 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:59:52.617998 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-ae3427cb-42ae-4061-92a2-b06774e04b50 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e" status: 200 len: 1724 microversion: 2.1 time: 0.150100 Sep 16 09:59:52.618550 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 525/1046] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:59:52 2022] GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:59:53.642249 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-ca90d8b5-7cb7-49e5-98b3-d3bdb568a03f tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:59:53.642857 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-ca90d8b5-7cb7-49e5-98b3-d3bdb568a03f tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:59:53.650072 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ca90d8b5-7cb7-49e5-98b3-d3bdb568a03f tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:59:53.650553 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ca90d8b5-7cb7-49e5-98b3-d3bdb568a03f tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:59:53.650987 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ca90d8b5-7cb7-49e5-98b3-d3bdb568a03f tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:59:53.651700 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ca90d8b5-7cb7-49e5-98b3-d3bdb568a03f tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:59:53.652155 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ca90d8b5-7cb7-49e5-98b3-d3bdb568a03f tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:59:53.652578 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ca90d8b5-7cb7-49e5-98b3-d3bdb568a03f tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:59:53.783005 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-ca90d8b5-7cb7-49e5-98b3-d3bdb568a03f tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:59:53.791116 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-ca90d8b5-7cb7-49e5-98b3-d3bdb568a03f tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e" status: 200 len: 1724 microversion: 2.1 time: 0.152853 Sep 16 09:59:53.791679 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 522/1047] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:59:53 2022] GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:59:54.814686 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-5de4d9be-82db-4f22-affc-13e7761b3b99 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:59:54.815298 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-5de4d9be-82db-4f22-affc-13e7761b3b99 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:59:54.822534 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5de4d9be-82db-4f22-affc-13e7761b3b99 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:59:54.823017 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5de4d9be-82db-4f22-affc-13e7761b3b99 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:59:54.823453 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5de4d9be-82db-4f22-affc-13e7761b3b99 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:59:54.824137 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5de4d9be-82db-4f22-affc-13e7761b3b99 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:59:54.824591 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5de4d9be-82db-4f22-affc-13e7761b3b99 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:59:54.825016 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5de4d9be-82db-4f22-affc-13e7761b3b99 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:59:54.957593 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-5de4d9be-82db-4f22-affc-13e7761b3b99 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:59:54.963691 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-5de4d9be-82db-4f22-affc-13e7761b3b99 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e" status: 200 len: 1724 microversion: 2.1 time: 0.152902 Sep 16 09:59:54.964283 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 526/1048] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:59:54 2022] GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:59:55.987053 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-2c4adcae-99e4-4c44-acdf-1fba85ed2637 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:59:55.987674 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-2c4adcae-99e4-4c44-acdf-1fba85ed2637 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:59:55.994347 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2c4adcae-99e4-4c44-acdf-1fba85ed2637 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:59:55.996692 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2c4adcae-99e4-4c44-acdf-1fba85ed2637 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:59:55.996692 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2c4adcae-99e4-4c44-acdf-1fba85ed2637 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:59:55.996692 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2c4adcae-99e4-4c44-acdf-1fba85ed2637 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:59:55.996692 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2c4adcae-99e4-4c44-acdf-1fba85ed2637 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:59:55.997113 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2c4adcae-99e4-4c44-acdf-1fba85ed2637 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:59:56.130676 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-2c4adcae-99e4-4c44-acdf-1fba85ed2637 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:59:56.139110 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-2c4adcae-99e4-4c44-acdf-1fba85ed2637 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e" status: 200 len: 1724 microversion: 2.1 time: 0.155920 Sep 16 09:59:56.139675 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 523/1049] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:59:55 2022] GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:59:57.163881 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-6e686ada-04ef-4e24-ab4d-3cc75e54b869 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:59:57.164487 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-6e686ada-04ef-4e24-ab4d-3cc75e54b869 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:59:57.170981 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6e686ada-04ef-4e24-ab4d-3cc75e54b869 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:59:57.171468 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6e686ada-04ef-4e24-ab4d-3cc75e54b869 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:59:57.171909 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6e686ada-04ef-4e24-ab4d-3cc75e54b869 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:59:57.172603 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6e686ada-04ef-4e24-ab4d-3cc75e54b869 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:59:57.173063 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6e686ada-04ef-4e24-ab4d-3cc75e54b869 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:59:57.173493 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6e686ada-04ef-4e24-ab4d-3cc75e54b869 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:59:57.305315 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-6e686ada-04ef-4e24-ab4d-3cc75e54b869 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:59:57.313714 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-6e686ada-04ef-4e24-ab4d-3cc75e54b869 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e" status: 200 len: 1724 microversion: 2.1 time: 0.154382 Sep 16 09:59:57.314279 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 527/1050] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:59:57 2022] GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:59:58.336398 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-4376e264-f6e5-410c-a96d-51a525105ebb tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:59:58.337019 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-4376e264-f6e5-410c-a96d-51a525105ebb tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:59:58.343897 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4376e264-f6e5-410c-a96d-51a525105ebb tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:59:58.344388 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4376e264-f6e5-410c-a96d-51a525105ebb tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:59:58.344831 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4376e264-f6e5-410c-a96d-51a525105ebb tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:59:58.345524 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4376e264-f6e5-410c-a96d-51a525105ebb tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:59:58.346008 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4376e264-f6e5-410c-a96d-51a525105ebb tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:59:58.346435 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4376e264-f6e5-410c-a96d-51a525105ebb tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:59:58.472212 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-4376e264-f6e5-410c-a96d-51a525105ebb tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:59:58.481335 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-4376e264-f6e5-410c-a96d-51a525105ebb tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e" status: 200 len: 1701 microversion: 2.1 time: 0.149004 Sep 16 09:59:58.481918 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 524/1051] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:59:58 2022] GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e => generated 1701 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:59:58.503625 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-cd1001f6-133b-4257-9e5d-9e20ba2cd664 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 09:59:58.510113 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-cd1001f6-133b-4257-9e5d-9e20ba2cd664 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:59:58.510603 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-cd1001f6-133b-4257-9e5d-9e20ba2cd664 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:59:58.511051 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-cd1001f6-133b-4257-9e5d-9e20ba2cd664 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:59:58.533139 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-cd1001f6-133b-4257-9e5d-9e20ba2cd664 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Going to try to start instance {{(pid=127671) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 16 09:59:58.751657 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-cd1001f6-133b-4257-9e5d-9e20ba2cd664 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "POST /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e/action" status: 202 len: 0 microversion: 2.1 time: 0.251599 Sep 16 09:59:58.752201 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 528/1052] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Sep 16 09:59:58 2022] POST /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 09:59:58.760708 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-f125dcb9-ff8f-42de-8552-d5ff0e8ca2e7 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:59:58.761327 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-f125dcb9-ff8f-42de-8552-d5ff0e8ca2e7 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:59:58.767557 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f125dcb9-ff8f-42de-8552-d5ff0e8ca2e7 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:59:58.768149 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f125dcb9-ff8f-42de-8552-d5ff0e8ca2e7 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:59:58.768593 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f125dcb9-ff8f-42de-8552-d5ff0e8ca2e7 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:59:58.769383 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f125dcb9-ff8f-42de-8552-d5ff0e8ca2e7 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:59:58.769889 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f125dcb9-ff8f-42de-8552-d5ff0e8ca2e7 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:59:58.770922 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f125dcb9-ff8f-42de-8552-d5ff0e8ca2e7 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:59:58.907269 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f125dcb9-ff8f-42de-8552-d5ff0e8ca2e7 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 09:59:58.915785 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-f125dcb9-ff8f-42de-8552-d5ff0e8ca2e7 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e" status: 200 len: 1710 microversion: 2.1 time: 0.158980 Sep 16 09:59:58.916358 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 525/1053] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:59:58 2022] GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e => generated 1710 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 09:59:59.939981 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-d56954eb-688e-43b3-bd24-8ad7a542005c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 09:59:59.940681 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-d56954eb-688e-43b3-bd24-8ad7a542005c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 09:59:59.947591 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d56954eb-688e-43b3-bd24-8ad7a542005c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:59:59.948075 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d56954eb-688e-43b3-bd24-8ad7a542005c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:59:59.948512 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d56954eb-688e-43b3-bd24-8ad7a542005c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 09:59:59.949206 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d56954eb-688e-43b3-bd24-8ad7a542005c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 09:59:59.949695 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d56954eb-688e-43b3-bd24-8ad7a542005c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 09:59:59.950126 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d56954eb-688e-43b3-bd24-8ad7a542005c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:00:00.080271 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-d56954eb-688e-43b3-bd24-8ad7a542005c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:00:00.089120 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-d56954eb-688e-43b3-bd24-8ad7a542005c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e" status: 200 len: 1710 microversion: 2.1 time: 0.153974 Sep 16 10:00:00.089706 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 529/1054] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 09:59:59 2022] GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e => generated 1710 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:00:01.113248 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-b752f4b5-3114-4653-a6d2-b3ce3e6761d4 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:00:01.113757 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-b752f4b5-3114-4653-a6d2-b3ce3e6761d4 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:00:01.119992 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b752f4b5-3114-4653-a6d2-b3ce3e6761d4 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:00:01.120480 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b752f4b5-3114-4653-a6d2-b3ce3e6761d4 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:00:01.120923 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b752f4b5-3114-4653-a6d2-b3ce3e6761d4 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:00:01.121650 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b752f4b5-3114-4653-a6d2-b3ce3e6761d4 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:00:01.122116 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b752f4b5-3114-4653-a6d2-b3ce3e6761d4 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:00:01.122544 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b752f4b5-3114-4653-a6d2-b3ce3e6761d4 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:00:01.250153 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-b752f4b5-3114-4653-a6d2-b3ce3e6761d4 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:00:01.259055 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-b752f4b5-3114-4653-a6d2-b3ce3e6761d4 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e" status: 200 len: 1714 microversion: 2.1 time: 0.150101 Sep 16 10:00:01.259624 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 526/1055] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:00:01 2022] GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e => generated 1714 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:00:33.712571 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-3413b6b6-db71-4457-b85b-e701d595b72e tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:00:33.713127 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-3413b6b6-db71-4457-b85b-e701d595b72e tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:00:33.715847 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_api:SELECT=22 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 10:00:33.716559 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 10:00:33.721237 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3413b6b6-db71-4457-b85b-e701d595b72e tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:00:33.729979 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3413b6b6-db71-4457-b85b-e701d595b72e tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:00:33.729979 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3413b6b6-db71-4457-b85b-e701d595b72e tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:00:33.729979 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3413b6b6-db71-4457-b85b-e701d595b72e tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:00:33.729979 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3413b6b6-db71-4457-b85b-e701d595b72e tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:00:33.730378 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3413b6b6-db71-4457-b85b-e701d595b72e tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:00:33.985491 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.objects.instance [None req-3413b6b6-db71-4457-b85b-e701d595b72e tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lazy-loading 'services' on Instance uuid 34302fd9-9a71-41c1-8392-6b9df5f0f75e {{(pid=127671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 10:00:34.147570 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-3413b6b6-db71-4457-b85b-e701d595b72e tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "DELETE /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e/os-volume_attachments/eafcfb1c-0d8e-4efb-8bc1-d35f61f97b5c" status: 202 len: 0 microversion: 2.1 time: 0.438834 Sep 16 10:00:34.148148 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 530/1056] 10.222.0.73 () {58 vars in 1416 bytes} [Fri Sep 16 10:00:33 2022] DELETE /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e/os-volume_attachments/eafcfb1c-0d8e-4efb-8bc1-d35f61f97b5c => generated 0 bytes in 440 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 10:00:35.267266 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-2d6e5dc2-f93a-4d50-9e69-fc2c13df8272 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 10:00:35.269468 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_api:SELECT=23 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 10:00:35.270144 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 10:00:35.274696 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2d6e5dc2-f93a-4d50-9e69-fc2c13df8272 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:00:35.275181 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2d6e5dc2-f93a-4d50-9e69-fc2c13df8272 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:00:35.275618 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2d6e5dc2-f93a-4d50-9e69-fc2c13df8272 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:00:35.337686 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-2d6e5dc2-f93a-4d50-9e69-fc2c13df8272 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Going to try to stop instance {{(pid=127670) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 16 10:00:35.495042 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-2d6e5dc2-f93a-4d50-9e69-fc2c13df8272 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "POST /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e/action" status: 202 len: 0 microversion: 2.1 time: 0.232391 Sep 16 10:00:35.495651 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 527/1057] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Sep 16 10:00:35 2022] POST /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 10:00:35.505413 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-3fe88225-7b3f-4e05-9b7d-fa6445750bc9 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:00:35.506156 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-3fe88225-7b3f-4e05-9b7d-fa6445750bc9 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:00:35.512603 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3fe88225-7b3f-4e05-9b7d-fa6445750bc9 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:00:35.513822 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3fe88225-7b3f-4e05-9b7d-fa6445750bc9 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:00:35.514283 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3fe88225-7b3f-4e05-9b7d-fa6445750bc9 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:00:35.515001 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3fe88225-7b3f-4e05-9b7d-fa6445750bc9 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:00:35.515470 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3fe88225-7b3f-4e05-9b7d-fa6445750bc9 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:00:35.515908 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3fe88225-7b3f-4e05-9b7d-fa6445750bc9 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:00:35.649791 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-3fe88225-7b3f-4e05-9b7d-fa6445750bc9 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:00:35.657407 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-3fe88225-7b3f-4e05-9b7d-fa6445750bc9 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e" status: 200 len: 1678 microversion: 2.1 time: 0.156785 Sep 16 10:00:35.657997 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 531/1058] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:00:35 2022] GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 10:00:36.682126 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-b1a71edc-8595-4e78-af8e-bef9c2a0cbf2 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:00:36.682860 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-b1a71edc-8595-4e78-af8e-bef9c2a0cbf2 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:00:36.689809 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b1a71edc-8595-4e78-af8e-bef9c2a0cbf2 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:00:36.690307 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b1a71edc-8595-4e78-af8e-bef9c2a0cbf2 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:00:36.690754 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b1a71edc-8595-4e78-af8e-bef9c2a0cbf2 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:00:36.691459 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b1a71edc-8595-4e78-af8e-bef9c2a0cbf2 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:00:36.691927 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b1a71edc-8595-4e78-af8e-bef9c2a0cbf2 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:00:36.692363 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b1a71edc-8595-4e78-af8e-bef9c2a0cbf2 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:00:36.876878 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-b1a71edc-8595-4e78-af8e-bef9c2a0cbf2 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:00:36.884529 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-b1a71edc-8595-4e78-af8e-bef9c2a0cbf2 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e" status: 200 len: 1678 microversion: 2.1 time: 0.207278 Sep 16 10:00:36.885096 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 528/1059] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:00:36 2022] GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e => generated 1678 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:00:37.908999 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-aede6b9a-bea3-4734-ad2e-e8ae72cc4db4 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:00:37.909639 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-aede6b9a-bea3-4734-ad2e-e8ae72cc4db4 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:00:37.916194 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-aede6b9a-bea3-4734-ad2e-e8ae72cc4db4 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:00:37.916684 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-aede6b9a-bea3-4734-ad2e-e8ae72cc4db4 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:00:37.917127 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-aede6b9a-bea3-4734-ad2e-e8ae72cc4db4 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:00:37.917858 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-aede6b9a-bea3-4734-ad2e-e8ae72cc4db4 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:00:37.918321 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-aede6b9a-bea3-4734-ad2e-e8ae72cc4db4 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:00:37.918753 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-aede6b9a-bea3-4734-ad2e-e8ae72cc4db4 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:00:38.050042 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-aede6b9a-bea3-4734-ad2e-e8ae72cc4db4 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:00:38.057591 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-aede6b9a-bea3-4734-ad2e-e8ae72cc4db4 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e" status: 200 len: 1678 microversion: 2.1 time: 0.153128 Sep 16 10:00:38.058149 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 532/1060] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:00:37 2022] GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:00:39.081028 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-f0461346-fdca-4516-9130-18645b0ca173 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:00:39.081715 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-f0461346-fdca-4516-9130-18645b0ca173 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:00:39.088254 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f0461346-fdca-4516-9130-18645b0ca173 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:00:39.093339 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f0461346-fdca-4516-9130-18645b0ca173 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:00:39.093339 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f0461346-fdca-4516-9130-18645b0ca173 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:00:39.093339 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f0461346-fdca-4516-9130-18645b0ca173 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:00:39.093339 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f0461346-fdca-4516-9130-18645b0ca173 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:00:39.093776 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f0461346-fdca-4516-9130-18645b0ca173 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:00:39.229871 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f0461346-fdca-4516-9130-18645b0ca173 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:00:39.239918 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-f0461346-fdca-4516-9130-18645b0ca173 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e" status: 200 len: 1678 microversion: 2.1 time: 0.162993 Sep 16 10:00:39.240505 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 529/1061] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:00:39 2022] GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:00:40.263074 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-15bcc364-8777-42fb-8a7c-d876c283a80b tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:00:40.263695 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-15bcc364-8777-42fb-8a7c-d876c283a80b tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:00:40.270810 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-15bcc364-8777-42fb-8a7c-d876c283a80b tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:00:40.271304 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-15bcc364-8777-42fb-8a7c-d876c283a80b tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:00:40.271750 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-15bcc364-8777-42fb-8a7c-d876c283a80b tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:00:40.272447 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-15bcc364-8777-42fb-8a7c-d876c283a80b tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:00:40.272913 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-15bcc364-8777-42fb-8a7c-d876c283a80b tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:00:40.273348 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-15bcc364-8777-42fb-8a7c-d876c283a80b tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:00:40.405639 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-15bcc364-8777-42fb-8a7c-d876c283a80b tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:00:40.413786 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-15bcc364-8777-42fb-8a7c-d876c283a80b tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e" status: 200 len: 1678 microversion: 2.1 time: 0.154648 Sep 16 10:00:40.414355 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 533/1062] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:00:40 2022] GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:00:41.436953 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-dc54c909-efd9-4bac-8641-8b3e51e88e01 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:00:41.437487 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-dc54c909-efd9-4bac-8641-8b3e51e88e01 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:00:41.443943 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dc54c909-efd9-4bac-8641-8b3e51e88e01 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:00:41.444434 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dc54c909-efd9-4bac-8641-8b3e51e88e01 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:00:41.444879 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dc54c909-efd9-4bac-8641-8b3e51e88e01 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:00:41.445592 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dc54c909-efd9-4bac-8641-8b3e51e88e01 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:00:41.446052 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dc54c909-efd9-4bac-8641-8b3e51e88e01 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:00:41.446481 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dc54c909-efd9-4bac-8641-8b3e51e88e01 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:00:41.573613 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-dc54c909-efd9-4bac-8641-8b3e51e88e01 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:00:41.584660 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-dc54c909-efd9-4bac-8641-8b3e51e88e01 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e" status: 200 len: 1678 microversion: 2.1 time: 0.152257 Sep 16 10:00:41.589983 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 530/1063] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:00:41 2022] GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:00:42.608349 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-853b1749-38e9-49d6-9e35-16d20a726065 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:00:42.608969 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-853b1749-38e9-49d6-9e35-16d20a726065 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:00:42.615410 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-853b1749-38e9-49d6-9e35-16d20a726065 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:00:42.615903 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-853b1749-38e9-49d6-9e35-16d20a726065 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:00:42.616349 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-853b1749-38e9-49d6-9e35-16d20a726065 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:00:42.617048 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-853b1749-38e9-49d6-9e35-16d20a726065 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:00:42.617514 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-853b1749-38e9-49d6-9e35-16d20a726065 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:00:42.617976 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-853b1749-38e9-49d6-9e35-16d20a726065 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:00:42.750999 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-853b1749-38e9-49d6-9e35-16d20a726065 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:00:42.758715 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-853b1749-38e9-49d6-9e35-16d20a726065 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e" status: 200 len: 1678 microversion: 2.1 time: 0.154530 Sep 16 10:00:42.759283 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 534/1064] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:00:42 2022] GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:00:43.783647 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d76e8347-f627-48fc-a554-d5b8a40c086c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:00:43.784272 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-d76e8347-f627-48fc-a554-d5b8a40c086c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:00:43.790857 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d76e8347-f627-48fc-a554-d5b8a40c086c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:00:43.791351 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d76e8347-f627-48fc-a554-d5b8a40c086c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:00:43.791794 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d76e8347-f627-48fc-a554-d5b8a40c086c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:00:43.792497 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d76e8347-f627-48fc-a554-d5b8a40c086c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:00:43.792962 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d76e8347-f627-48fc-a554-d5b8a40c086c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:00:43.793397 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d76e8347-f627-48fc-a554-d5b8a40c086c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:00:43.924645 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-d76e8347-f627-48fc-a554-d5b8a40c086c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:00:43.932630 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-d76e8347-f627-48fc-a554-d5b8a40c086c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e" status: 200 len: 1678 microversion: 2.1 time: 0.153799 Sep 16 10:00:43.933211 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 531/1065] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:00:43 2022] GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:00:44.956444 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-95397dfe-9d7f-48bf-97c7-7e5533f6f565 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:00:44.957052 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-95397dfe-9d7f-48bf-97c7-7e5533f6f565 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:00:44.963556 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-95397dfe-9d7f-48bf-97c7-7e5533f6f565 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:00:44.964070 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-95397dfe-9d7f-48bf-97c7-7e5533f6f565 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:00:44.964552 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-95397dfe-9d7f-48bf-97c7-7e5533f6f565 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:00:44.965238 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-95397dfe-9d7f-48bf-97c7-7e5533f6f565 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:00:44.965733 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-95397dfe-9d7f-48bf-97c7-7e5533f6f565 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:00:44.966160 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-95397dfe-9d7f-48bf-97c7-7e5533f6f565 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:00:45.101460 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-95397dfe-9d7f-48bf-97c7-7e5533f6f565 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:00:45.109287 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-95397dfe-9d7f-48bf-97c7-7e5533f6f565 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e" status: 200 len: 1678 microversion: 2.1 time: 0.156821 Sep 16 10:00:45.109892 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 535/1066] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:00:44 2022] GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:00:46.133058 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-2e6d63ff-ad98-44ff-8bd0-603625854e07 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:00:46.133707 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-2e6d63ff-ad98-44ff-8bd0-603625854e07 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:00:46.136116 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 10:00:46.136268 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Fri Sep 16 10:00:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e (ip 10.222.0.73) !!! Sep 16 10:00:46.143571 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2e6d63ff-ad98-44ff-8bd0-603625854e07 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:00:46.144061 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2e6d63ff-ad98-44ff-8bd0-603625854e07 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:00:46.144501 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2e6d63ff-ad98-44ff-8bd0-603625854e07 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:00:46.145202 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2e6d63ff-ad98-44ff-8bd0-603625854e07 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:00:46.145691 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2e6d63ff-ad98-44ff-8bd0-603625854e07 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:00:46.146120 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-2e6d63ff-ad98-44ff-8bd0-603625854e07 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:00:46.275694 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-2e6d63ff-ad98-44ff-8bd0-603625854e07 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:00:46.283708 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-2e6d63ff-ad98-44ff-8bd0-603625854e07 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e" status: 200 len: 1655 microversion: 2.1 time: 0.154563 Sep 16 10:00:46.284284 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 532/1067] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:00:46 2022] GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e => generated 1655 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:00:46.306282 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-3262000e-24ee-4277-b193-7095b0bd56cc tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 10:00:46.313250 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3262000e-24ee-4277-b193-7095b0bd56cc tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:00:46.313791 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3262000e-24ee-4277-b193-7095b0bd56cc tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:00:46.314232 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3262000e-24ee-4277-b193-7095b0bd56cc tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:00:46.336436 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-3262000e-24ee-4277-b193-7095b0bd56cc tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Going to try to start instance {{(pid=127671) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 16 10:00:46.482810 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-3262000e-24ee-4277-b193-7095b0bd56cc tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "POST /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e/action" status: 202 len: 0 microversion: 2.1 time: 0.180379 Sep 16 10:00:46.483527 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 536/1068] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Sep 16 10:00:46 2022] POST /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 10:00:46.492256 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-8f849e2b-db4f-4c7a-b447-b2ee4fa82f36 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:00:46.492878 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-8f849e2b-db4f-4c7a-b447-b2ee4fa82f36 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:00:46.499304 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8f849e2b-db4f-4c7a-b447-b2ee4fa82f36 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:00:46.499850 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8f849e2b-db4f-4c7a-b447-b2ee4fa82f36 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:00:46.500350 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8f849e2b-db4f-4c7a-b447-b2ee4fa82f36 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:00:46.501063 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8f849e2b-db4f-4c7a-b447-b2ee4fa82f36 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:00:46.501526 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8f849e2b-db4f-4c7a-b447-b2ee4fa82f36 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:00:46.502023 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8f849e2b-db4f-4c7a-b447-b2ee4fa82f36 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:00:46.637973 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-8f849e2b-db4f-4c7a-b447-b2ee4fa82f36 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:00:46.648087 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-8f849e2b-db4f-4c7a-b447-b2ee4fa82f36 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e" status: 200 len: 1664 microversion: 2.1 time: 0.159684 Sep 16 10:00:46.648670 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 533/1069] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:00:46 2022] GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e => generated 1664 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:00:47.673662 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-3d1b2658-3d9b-46bc-b7f7-90f25391cea3 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:00:47.674369 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-3d1b2658-3d9b-46bc-b7f7-90f25391cea3 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:00:47.680510 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3d1b2658-3d9b-46bc-b7f7-90f25391cea3 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:00:47.680996 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3d1b2658-3d9b-46bc-b7f7-90f25391cea3 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:00:47.681433 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3d1b2658-3d9b-46bc-b7f7-90f25391cea3 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:00:47.682148 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3d1b2658-3d9b-46bc-b7f7-90f25391cea3 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:00:47.682608 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3d1b2658-3d9b-46bc-b7f7-90f25391cea3 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:00:47.683036 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3d1b2658-3d9b-46bc-b7f7-90f25391cea3 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:00:47.812148 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-3d1b2658-3d9b-46bc-b7f7-90f25391cea3 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:00:47.820164 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-3d1b2658-3d9b-46bc-b7f7-90f25391cea3 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e" status: 200 len: 1664 microversion: 2.1 time: 0.151841 Sep 16 10:00:47.820741 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 537/1070] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:00:47 2022] GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e => generated 1664 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:00:48.843500 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-a5b88035-2849-4562-83c1-5e630e079af1 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:00:48.844125 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-a5b88035-2849-4562-83c1-5e630e079af1 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:00:48.850945 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a5b88035-2849-4562-83c1-5e630e079af1 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:00:48.851468 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a5b88035-2849-4562-83c1-5e630e079af1 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:00:48.851912 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a5b88035-2849-4562-83c1-5e630e079af1 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:00:48.852613 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a5b88035-2849-4562-83c1-5e630e079af1 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:00:48.853082 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a5b88035-2849-4562-83c1-5e630e079af1 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:00:48.853514 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a5b88035-2849-4562-83c1-5e630e079af1 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:00:48.982813 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-a5b88035-2849-4562-83c1-5e630e079af1 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:00:48.991204 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-a5b88035-2849-4562-83c1-5e630e079af1 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e" status: 200 len: 1668 microversion: 2.1 time: 0.151630 Sep 16 10:00:48.991768 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 534/1071] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:00:48 2022] GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e => generated 1668 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:01:06.071234 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-27a97a00-88c6-42ce-b887-14fc22827ff5 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 10:01:06.071843 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-27a97a00-88c6-42ce-b887-14fc22827ff5 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:01:06.074054 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_api:SELECT=16 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 10:01:06.074703 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 10:01:06.079889 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-27a97a00-88c6-42ce-b887-14fc22827ff5 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:06.080365 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-27a97a00-88c6-42ce-b887-14fc22827ff5 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:06.080908 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-27a97a00-88c6-42ce-b887-14fc22827ff5 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:06.081530 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-27a97a00-88c6-42ce-b887-14fc22827ff5 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:06.082012 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-27a97a00-88c6-42ce-b887-14fc22827ff5 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:06.088622 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-27a97a00-88c6-42ce-b887-14fc22827ff5 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:06.105321 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.objects.instance [None req-27a97a00-88c6-42ce-b887-14fc22827ff5 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lazy-loading 'flavor' on Instance uuid 70372e0b-76cc-4156-84ae-3734dd9f7b25 {{(pid=127671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 10:01:06.392974 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-27a97a00-88c6-42ce-b887-14fc22827ff5 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "POST /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25/action" status: 202 len: 0 microversion: 2.1 time: 0.325408 Sep 16 10:01:06.394578 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 538/1072] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Sep 16 10:01:06 2022] POST /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 10:01:06.401933 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-0f9353be-3b49-4145-af2d-8ed23258846c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:01:06.402548 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-0f9353be-3b49-4145-af2d-8ed23258846c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:01:06.404674 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_api:SELECT=16 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 10:01:06.405385 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 10:01:06.409973 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0f9353be-3b49-4145-af2d-8ed23258846c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:06.410414 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0f9353be-3b49-4145-af2d-8ed23258846c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:06.410848 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0f9353be-3b49-4145-af2d-8ed23258846c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:06.411530 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0f9353be-3b49-4145-af2d-8ed23258846c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:06.411984 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0f9353be-3b49-4145-af2d-8ed23258846c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:06.412407 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-0f9353be-3b49-4145-af2d-8ed23258846c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:06.547606 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-0f9353be-3b49-4145-af2d-8ed23258846c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff870e07952c4e049e17a096c477165b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e292a400454c93a48aca5510bfcee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:01:06.555220 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-0f9353be-3b49-4145-af2d-8ed23258846c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25" status: 200 len: 1569 microversion: 2.1 time: 0.157407 Sep 16 10:01:06.555797 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 535/1073] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:01:06 2022] GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:01:07.580695 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-2b2134d4-6491-4aff-847a-58da8a6af0a2 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:01:07.581403 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-2b2134d4-6491-4aff-847a-58da8a6af0a2 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:01:07.587619 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2b2134d4-6491-4aff-847a-58da8a6af0a2 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:07.588111 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2b2134d4-6491-4aff-847a-58da8a6af0a2 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:07.588551 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2b2134d4-6491-4aff-847a-58da8a6af0a2 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:07.589245 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2b2134d4-6491-4aff-847a-58da8a6af0a2 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:07.589745 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2b2134d4-6491-4aff-847a-58da8a6af0a2 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:07.590177 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2b2134d4-6491-4aff-847a-58da8a6af0a2 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:07.719206 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-2b2134d4-6491-4aff-847a-58da8a6af0a2 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff870e07952c4e049e17a096c477165b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e292a400454c93a48aca5510bfcee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:01:07.727309 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-2b2134d4-6491-4aff-847a-58da8a6af0a2 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25" status: 200 len: 1569 microversion: 2.1 time: 0.151996 Sep 16 10:01:07.727874 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 539/1074] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:01:07 2022] GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:01:08.750638 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-b408d9cb-f2df-4f9c-80c4-497affee8f97 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:01:08.751211 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-b408d9cb-f2df-4f9c-80c4-497affee8f97 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:01:08.758281 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b408d9cb-f2df-4f9c-80c4-497affee8f97 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:08.758771 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b408d9cb-f2df-4f9c-80c4-497affee8f97 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:08.759213 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b408d9cb-f2df-4f9c-80c4-497affee8f97 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:08.759913 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b408d9cb-f2df-4f9c-80c4-497affee8f97 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:08.760375 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b408d9cb-f2df-4f9c-80c4-497affee8f97 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:08.760805 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b408d9cb-f2df-4f9c-80c4-497affee8f97 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:08.892032 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-b408d9cb-f2df-4f9c-80c4-497affee8f97 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff870e07952c4e049e17a096c477165b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e292a400454c93a48aca5510bfcee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:01:08.899897 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-b408d9cb-f2df-4f9c-80c4-497affee8f97 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25" status: 200 len: 1569 microversion: 2.1 time: 0.153461 Sep 16 10:01:08.900456 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 536/1075] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:01:08 2022] GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:01:09.925138 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-0382e2fe-b918-4459-abb9-ece3c7eff68d tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:01:09.925787 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-0382e2fe-b918-4459-abb9-ece3c7eff68d tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:01:09.932204 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-0382e2fe-b918-4459-abb9-ece3c7eff68d tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:09.932693 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-0382e2fe-b918-4459-abb9-ece3c7eff68d tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:09.933135 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-0382e2fe-b918-4459-abb9-ece3c7eff68d tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:09.933863 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-0382e2fe-b918-4459-abb9-ece3c7eff68d tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:09.934325 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-0382e2fe-b918-4459-abb9-ece3c7eff68d tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:09.934759 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-0382e2fe-b918-4459-abb9-ece3c7eff68d tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:10.066819 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-0382e2fe-b918-4459-abb9-ece3c7eff68d tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff870e07952c4e049e17a096c477165b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e292a400454c93a48aca5510bfcee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:01:10.074764 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-0382e2fe-b918-4459-abb9-ece3c7eff68d tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25" status: 200 len: 1569 microversion: 2.1 time: 0.153763 Sep 16 10:01:10.075328 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 540/1076] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:01:09 2022] GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:01:11.097402 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-261b3bdc-13fb-4e90-b89e-87a3e82de5b0 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:01:11.098044 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-261b3bdc-13fb-4e90-b89e-87a3e82de5b0 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:01:11.104403 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-261b3bdc-13fb-4e90-b89e-87a3e82de5b0 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:11.104883 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-261b3bdc-13fb-4e90-b89e-87a3e82de5b0 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:11.105320 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-261b3bdc-13fb-4e90-b89e-87a3e82de5b0 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:11.106034 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-261b3bdc-13fb-4e90-b89e-87a3e82de5b0 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:11.106491 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-261b3bdc-13fb-4e90-b89e-87a3e82de5b0 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:11.106941 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-261b3bdc-13fb-4e90-b89e-87a3e82de5b0 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:11.240227 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-261b3bdc-13fb-4e90-b89e-87a3e82de5b0 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff870e07952c4e049e17a096c477165b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e292a400454c93a48aca5510bfcee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:01:11.248788 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-261b3bdc-13fb-4e90-b89e-87a3e82de5b0 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25" status: 200 len: 1569 microversion: 2.1 time: 0.154810 Sep 16 10:01:11.249662 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 537/1077] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:01:11 2022] GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:01:12.273454 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-4c2d5520-0118-45e9-8dc7-c0fc5a38ce51 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:01:12.274082 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-4c2d5520-0118-45e9-8dc7-c0fc5a38ce51 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:01:12.276865 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 10:01:12.277002 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Fri Sep 16 10:01:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25 (ip 10.222.0.73) !!! Sep 16 10:01:12.284724 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4c2d5520-0118-45e9-8dc7-c0fc5a38ce51 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:12.285204 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4c2d5520-0118-45e9-8dc7-c0fc5a38ce51 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:12.285669 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4c2d5520-0118-45e9-8dc7-c0fc5a38ce51 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:12.286362 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4c2d5520-0118-45e9-8dc7-c0fc5a38ce51 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:12.286817 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4c2d5520-0118-45e9-8dc7-c0fc5a38ce51 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:12.287240 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4c2d5520-0118-45e9-8dc7-c0fc5a38ce51 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:12.423802 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-4c2d5520-0118-45e9-8dc7-c0fc5a38ce51 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff870e07952c4e049e17a096c477165b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e292a400454c93a48aca5510bfcee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:01:12.431457 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-4c2d5520-0118-45e9-8dc7-c0fc5a38ce51 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25" status: 200 len: 1569 microversion: 2.1 time: 0.161895 Sep 16 10:01:12.432020 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 541/1078] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:01:12 2022] GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:01:13.454967 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-70ca42dd-6499-41a1-8a5f-bb44af91eeb1 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:01:13.455608 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-70ca42dd-6499-41a1-8a5f-bb44af91eeb1 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:01:13.462031 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-70ca42dd-6499-41a1-8a5f-bb44af91eeb1 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:13.462515 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-70ca42dd-6499-41a1-8a5f-bb44af91eeb1 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:13.462947 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-70ca42dd-6499-41a1-8a5f-bb44af91eeb1 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:13.463637 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-70ca42dd-6499-41a1-8a5f-bb44af91eeb1 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:13.464090 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-70ca42dd-6499-41a1-8a5f-bb44af91eeb1 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:13.464513 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-70ca42dd-6499-41a1-8a5f-bb44af91eeb1 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:13.538265 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 10:01:13.538487 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Fri Sep 16 10:01:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25 (ip 10.222.0.73) !!! Sep 16 10:01:13.596656 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-70ca42dd-6499-41a1-8a5f-bb44af91eeb1 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff870e07952c4e049e17a096c477165b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e292a400454c93a48aca5510bfcee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:01:13.604397 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-70ca42dd-6499-41a1-8a5f-bb44af91eeb1 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25" status: 200 len: 1569 microversion: 2.1 time: 0.153430 Sep 16 10:01:13.604959 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 538/1079] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:01:13 2022] GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:01:14.627391 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-3c22fdcf-cb1c-4df3-81ec-e65ea427759f tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:01:14.628010 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-3c22fdcf-cb1c-4df3-81ec-e65ea427759f tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:01:14.635188 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3c22fdcf-cb1c-4df3-81ec-e65ea427759f tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:14.635673 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3c22fdcf-cb1c-4df3-81ec-e65ea427759f tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:14.636107 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3c22fdcf-cb1c-4df3-81ec-e65ea427759f tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:14.636788 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3c22fdcf-cb1c-4df3-81ec-e65ea427759f tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:14.637238 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3c22fdcf-cb1c-4df3-81ec-e65ea427759f tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:14.637691 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3c22fdcf-cb1c-4df3-81ec-e65ea427759f tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:14.773463 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-3c22fdcf-cb1c-4df3-81ec-e65ea427759f tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff870e07952c4e049e17a096c477165b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e292a400454c93a48aca5510bfcee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:01:14.781247 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-3c22fdcf-cb1c-4df3-81ec-e65ea427759f tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25" status: 200 len: 1569 microversion: 2.1 time: 0.157762 Sep 16 10:01:14.781841 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 542/1080] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:01:14 2022] GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:01:15.804061 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-b0ea673c-c01d-4208-8b5f-c5e90f0879fc tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:01:15.804625 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-b0ea673c-c01d-4208-8b5f-c5e90f0879fc tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:01:15.811100 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b0ea673c-c01d-4208-8b5f-c5e90f0879fc tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:15.811617 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b0ea673c-c01d-4208-8b5f-c5e90f0879fc tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:15.812057 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b0ea673c-c01d-4208-8b5f-c5e90f0879fc tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:15.812745 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b0ea673c-c01d-4208-8b5f-c5e90f0879fc tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:15.813202 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b0ea673c-c01d-4208-8b5f-c5e90f0879fc tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:15.813661 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b0ea673c-c01d-4208-8b5f-c5e90f0879fc tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:15.940308 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-b0ea673c-c01d-4208-8b5f-c5e90f0879fc tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff870e07952c4e049e17a096c477165b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e292a400454c93a48aca5510bfcee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:01:15.948031 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-b0ea673c-c01d-4208-8b5f-c5e90f0879fc tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25" status: 200 len: 1569 microversion: 2.1 time: 0.147970 Sep 16 10:01:15.948626 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 539/1081] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:01:15 2022] GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:01:16.974170 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-3df39dee-5a4e-4a62-84f2-32e6b2192536 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:01:16.974786 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-3df39dee-5a4e-4a62-84f2-32e6b2192536 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:01:16.981200 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3df39dee-5a4e-4a62-84f2-32e6b2192536 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:16.981715 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3df39dee-5a4e-4a62-84f2-32e6b2192536 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:16.982188 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3df39dee-5a4e-4a62-84f2-32e6b2192536 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:16.982880 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3df39dee-5a4e-4a62-84f2-32e6b2192536 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:16.983857 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3df39dee-5a4e-4a62-84f2-32e6b2192536 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:16.984280 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-3df39dee-5a4e-4a62-84f2-32e6b2192536 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:17.116410 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-3df39dee-5a4e-4a62-84f2-32e6b2192536 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff870e07952c4e049e17a096c477165b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e292a400454c93a48aca5510bfcee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:01:17.124259 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-3df39dee-5a4e-4a62-84f2-32e6b2192536 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25" status: 200 len: 1569 microversion: 2.1 time: 0.154208 Sep 16 10:01:17.124824 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 543/1082] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:01:16 2022] GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:01:18.147056 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-c2dac47e-eeb4-4a9e-962b-d8513146931a tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:01:18.147667 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-c2dac47e-eeb4-4a9e-962b-d8513146931a tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:01:18.154166 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c2dac47e-eeb4-4a9e-962b-d8513146931a tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:18.154644 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c2dac47e-eeb4-4a9e-962b-d8513146931a tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:18.155079 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c2dac47e-eeb4-4a9e-962b-d8513146931a tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:18.155758 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c2dac47e-eeb4-4a9e-962b-d8513146931a tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:18.156208 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c2dac47e-eeb4-4a9e-962b-d8513146931a tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:18.156629 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c2dac47e-eeb4-4a9e-962b-d8513146931a tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:18.284973 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c2dac47e-eeb4-4a9e-962b-d8513146931a tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff870e07952c4e049e17a096c477165b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e292a400454c93a48aca5510bfcee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:01:18.292589 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-c2dac47e-eeb4-4a9e-962b-d8513146931a tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25" status: 200 len: 1569 microversion: 2.1 time: 0.149391 Sep 16 10:01:18.293185 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 540/1083] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:01:18 2022] GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:01:19.320399 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-8b9d307c-f536-4b0c-9ddd-02435d9f92fe tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:01:19.321218 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-8b9d307c-f536-4b0c-9ddd-02435d9f92fe tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:01:19.330191 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8b9d307c-f536-4b0c-9ddd-02435d9f92fe tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:19.330690 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8b9d307c-f536-4b0c-9ddd-02435d9f92fe tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:19.331140 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8b9d307c-f536-4b0c-9ddd-02435d9f92fe tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:19.331846 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8b9d307c-f536-4b0c-9ddd-02435d9f92fe tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:19.332312 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8b9d307c-f536-4b0c-9ddd-02435d9f92fe tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:19.332743 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8b9d307c-f536-4b0c-9ddd-02435d9f92fe tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:19.472550 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-8b9d307c-f536-4b0c-9ddd-02435d9f92fe tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff870e07952c4e049e17a096c477165b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e292a400454c93a48aca5510bfcee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:01:19.480405 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-8b9d307c-f536-4b0c-9ddd-02435d9f92fe tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25" status: 200 len: 1569 microversion: 2.1 time: 0.167109 Sep 16 10:01:19.480974 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 544/1084] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:01:19 2022] GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:01:20.504901 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-bc1c39e0-bd54-4742-961e-c131bb13a054 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:01:20.505515 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-bc1c39e0-bd54-4742-961e-c131bb13a054 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:01:20.511902 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bc1c39e0-bd54-4742-961e-c131bb13a054 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:20.512383 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bc1c39e0-bd54-4742-961e-c131bb13a054 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:20.512815 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bc1c39e0-bd54-4742-961e-c131bb13a054 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:20.513500 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bc1c39e0-bd54-4742-961e-c131bb13a054 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:20.513973 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bc1c39e0-bd54-4742-961e-c131bb13a054 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:20.514885 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-bc1c39e0-bd54-4742-961e-c131bb13a054 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:20.643886 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-bc1c39e0-bd54-4742-961e-c131bb13a054 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff870e07952c4e049e17a096c477165b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e292a400454c93a48aca5510bfcee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:01:20.651610 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-bc1c39e0-bd54-4742-961e-c131bb13a054 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25" status: 200 len: 1510 microversion: 2.1 time: 0.150644 Sep 16 10:01:20.652180 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 541/1085] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:01:20 2022] GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25 => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:01:20.676110 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-93db16d1-354b-4b1f-b120-fc4e26f91bc6 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 10:01:20.676742 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-93db16d1-354b-4b1f-b120-fc4e26f91bc6 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:01:20.683213 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-93db16d1-354b-4b1f-b120-fc4e26f91bc6 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:20.683699 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-93db16d1-354b-4b1f-b120-fc4e26f91bc6 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:20.684143 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-93db16d1-354b-4b1f-b120-fc4e26f91bc6 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:20.684835 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-93db16d1-354b-4b1f-b120-fc4e26f91bc6 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:20.685301 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-93db16d1-354b-4b1f-b120-fc4e26f91bc6 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:20.685769 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-93db16d1-354b-4b1f-b120-fc4e26f91bc6 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:20.715600 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-93db16d1-354b-4b1f-b120-fc4e26f91bc6 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127671) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 16 10:01:20.990928 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-93db16d1-354b-4b1f-b120-fc4e26f91bc6 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "POST /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25/action" status: 202 len: 0 microversion: 2.1 time: 0.318228 Sep 16 10:01:20.991462 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 545/1086] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Sep 16 10:01:20 2022] POST /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 10:01:21.000710 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-502ce5ab-dae0-4dc7-865a-70c99bc65849 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:01:21.001056 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-502ce5ab-dae0-4dc7-865a-70c99bc65849 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:01:21.007224 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-502ce5ab-dae0-4dc7-865a-70c99bc65849 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:21.007782 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-502ce5ab-dae0-4dc7-865a-70c99bc65849 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:21.008235 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-502ce5ab-dae0-4dc7-865a-70c99bc65849 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:21.008939 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-502ce5ab-dae0-4dc7-865a-70c99bc65849 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:21.009404 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-502ce5ab-dae0-4dc7-865a-70c99bc65849 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:21.009867 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-502ce5ab-dae0-4dc7-865a-70c99bc65849 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:21.159217 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-09c3c7ce-8f09-410d-9c55-2dd57ff938cf tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:01:21.161475 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-09c3c7ce-8f09-410d-9c55-2dd57ff938cf tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:01:21.167497 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-09c3c7ce-8f09-410d-9c55-2dd57ff938cf tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:21.167914 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-09c3c7ce-8f09-410d-9c55-2dd57ff938cf tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:21.168360 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-09c3c7ce-8f09-410d-9c55-2dd57ff938cf tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:21.169063 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-09c3c7ce-8f09-410d-9c55-2dd57ff938cf tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:21.170011 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-09c3c7ce-8f09-410d-9c55-2dd57ff938cf tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:21.170011 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-09c3c7ce-8f09-410d-9c55-2dd57ff938cf tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:21.177994 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-502ce5ab-dae0-4dc7-865a-70c99bc65849 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff870e07952c4e049e17a096c477165b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e292a400454c93a48aca5510bfcee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:01:21.187004 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-502ce5ab-dae0-4dc7-865a-70c99bc65849 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25" status: 200 len: 1518 microversion: 2.1 time: 0.190813 Sep 16 10:01:21.187597 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 542/1087] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:01:20 2022] GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25 => generated 1518 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:01:21.202052 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-09c3c7ce-8f09-410d-9c55-2dd57ff938cf tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046660 Sep 16 10:01:21.202647 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 546/1088] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Sep 16 10:01:21 2022] GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 16 10:01:21.266045 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-c350425b-9038-44b7-b56e-ae741bbf54c6 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:01:21.266740 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-c350425b-9038-44b7-b56e-ae741bbf54c6 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:01:21.272723 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c350425b-9038-44b7-b56e-ae741bbf54c6 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:21.273213 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c350425b-9038-44b7-b56e-ae741bbf54c6 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:21.273682 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c350425b-9038-44b7-b56e-ae741bbf54c6 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:21.274387 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c350425b-9038-44b7-b56e-ae741bbf54c6 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:21.274845 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c350425b-9038-44b7-b56e-ae741bbf54c6 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:21.275274 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c350425b-9038-44b7-b56e-ae741bbf54c6 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:21.301449 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-c350425b-9038-44b7-b56e-ae741bbf54c6 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Going to try to terminate instance {{(pid=127670) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 10:01:21.639751 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-c350425b-9038-44b7-b56e-ae741bbf54c6 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "DELETE /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e" status: 204 len: 0 microversion: 2.1 time: 0.376689 Sep 16 10:01:21.640410 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 543/1089] 10.222.0.73 () {58 vars in 1239 bytes} [Fri Sep 16 10:01:21 2022] DELETE /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 10:01:21.648421 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-785f49b4-6516-4ead-a5ff-9a9e77dc2740 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:01:21.654312 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-785f49b4-6516-4ead-a5ff-9a9e77dc2740 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:01:21.654977 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-785f49b4-6516-4ead-a5ff-9a9e77dc2740 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:21.655461 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-785f49b4-6516-4ead-a5ff-9a9e77dc2740 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:21.655894 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-785f49b4-6516-4ead-a5ff-9a9e77dc2740 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:21.656580 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-785f49b4-6516-4ead-a5ff-9a9e77dc2740 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:21.657058 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-785f49b4-6516-4ead-a5ff-9a9e77dc2740 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:21.657455 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-785f49b4-6516-4ead-a5ff-9a9e77dc2740 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:21.789496 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-785f49b4-6516-4ead-a5ff-9a9e77dc2740 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:01:21.797529 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-785f49b4-6516-4ead-a5ff-9a9e77dc2740 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e" status: 200 len: 1674 microversion: 2.1 time: 0.152855 Sep 16 10:01:21.798116 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 547/1090] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:01:21 2022] GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:01:22.210497 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-86a71cb2-635e-4afc-85a0-e914e510efa9 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:01:22.211238 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-86a71cb2-635e-4afc-85a0-e914e510efa9 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:01:22.217238 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-86a71cb2-635e-4afc-85a0-e914e510efa9 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:22.217842 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-86a71cb2-635e-4afc-85a0-e914e510efa9 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:22.218302 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-86a71cb2-635e-4afc-85a0-e914e510efa9 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:22.219098 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-86a71cb2-635e-4afc-85a0-e914e510efa9 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:22.219454 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-86a71cb2-635e-4afc-85a0-e914e510efa9 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:22.219882 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-86a71cb2-635e-4afc-85a0-e914e510efa9 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:22.352732 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-86a71cb2-635e-4afc-85a0-e914e510efa9 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff870e07952c4e049e17a096c477165b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e292a400454c93a48aca5510bfcee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:01:22.360531 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-86a71cb2-635e-4afc-85a0-e914e510efa9 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25" status: 200 len: 1518 microversion: 2.1 time: 0.154254 Sep 16 10:01:22.361249 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 544/1091] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:01:22 2022] GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 10:01:22.821169 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-79ae1f6b-cf26-437a-8522-72005fab27fd tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:01:22.821820 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-79ae1f6b-cf26-437a-8522-72005fab27fd tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:01:22.828873 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-79ae1f6b-cf26-437a-8522-72005fab27fd tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:22.829140 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-79ae1f6b-cf26-437a-8522-72005fab27fd tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:22.829616 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-79ae1f6b-cf26-437a-8522-72005fab27fd tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:22.830363 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-79ae1f6b-cf26-437a-8522-72005fab27fd tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:22.830846 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-79ae1f6b-cf26-437a-8522-72005fab27fd tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:22.831285 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-79ae1f6b-cf26-437a-8522-72005fab27fd tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:22.958473 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-79ae1f6b-cf26-437a-8522-72005fab27fd tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:01:22.966106 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-79ae1f6b-cf26-437a-8522-72005fab27fd tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e" status: 200 len: 1674 microversion: 2.1 time: 0.148937 Sep 16 10:01:22.966661 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 548/1092] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:01:22 2022] GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e => generated 1674 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:01:23.118599 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-71960680-c081-4cc9-96d9-8a97253420ea req-18328710-5239-41d2-9385-567ef440a132 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70372e0b-76cc-4156-84ae-3734dd9f7b25", "name": "network-vif-unplugged", "status": "completed", "tag": "cc7b6bd5-7e7c-4cc5-8097-75cfcd4c3ad8"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 10:01:23.129858 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-71960680-c081-4cc9-96d9-8a97253420ea req-18328710-5239-41d2-9385-567ef440a132 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:23.130350 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-71960680-c081-4cc9-96d9-8a97253420ea req-18328710-5239-41d2-9385-567ef440a132 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:23.130790 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-71960680-c081-4cc9-96d9-8a97253420ea req-18328710-5239-41d2-9385-567ef440a132 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:23.150596 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.compute.server_external_events [req-71960680-c081-4cc9-96d9-8a97253420ea req-18328710-5239-41d2-9385-567ef440a132 service nova] Unable to find a host for instance 70372e0b-76cc-4156-84ae-3734dd9f7b25. Dropping event network-vif-unplugged {{(pid=127670) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 16 10:01:23.151509 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-71960680-c081-4cc9-96d9-8a97253420ea req-18328710-5239-41d2-9385-567ef440a132 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036736 Sep 16 10:01:23.152110 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 545/1093] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 10:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 16 10:01:23.383934 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-fe5c586a-6c4c-4014-b1cd-cb3fa06da778 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:01:23.384502 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-fe5c586a-6c4c-4014-b1cd-cb3fa06da778 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:01:23.391822 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-fe5c586a-6c4c-4014-b1cd-cb3fa06da778 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:23.392319 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-fe5c586a-6c4c-4014-b1cd-cb3fa06da778 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:23.392766 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-fe5c586a-6c4c-4014-b1cd-cb3fa06da778 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:23.393480 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-fe5c586a-6c4c-4014-b1cd-cb3fa06da778 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:23.393976 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-fe5c586a-6c4c-4014-b1cd-cb3fa06da778 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:23.394410 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-fe5c586a-6c4c-4014-b1cd-cb3fa06da778 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:23.546976 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-fe5c586a-6c4c-4014-b1cd-cb3fa06da778 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff870e07952c4e049e17a096c477165b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e292a400454c93a48aca5510bfcee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:01:23.555410 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-fe5c586a-6c4c-4014-b1cd-cb3fa06da778 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25" status: 200 len: 1518 microversion: 2.1 time: 0.175055 Sep 16 10:01:23.556004 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 549/1094] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:01:23 2022] GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25 => generated 1518 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:01:23.990561 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-50db2902-47e1-4f86-8d11-24dbd20f3cc3 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:01:23.994530 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-50db2902-47e1-4f86-8d11-24dbd20f3cc3 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:01:23.997656 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-50db2902-47e1-4f86-8d11-24dbd20f3cc3 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:23.998153 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-50db2902-47e1-4f86-8d11-24dbd20f3cc3 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:23.999201 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-50db2902-47e1-4f86-8d11-24dbd20f3cc3 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:23.999962 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-50db2902-47e1-4f86-8d11-24dbd20f3cc3 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:24.000426 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-50db2902-47e1-4f86-8d11-24dbd20f3cc3 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:24.000854 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-50db2902-47e1-4f86-8d11-24dbd20f3cc3 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:24.443250 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-50db2902-47e1-4f86-8d11-24dbd20f3cc3 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:01:24.455564 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-50db2902-47e1-4f86-8d11-24dbd20f3cc3 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e" status: 200 len: 1674 microversion: 2.1 time: 0.465972 Sep 16 10:01:24.455564 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 546/1095] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:01:23 2022] GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e => generated 1674 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:01:24.581364 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-67fc4218-d631-488e-949e-02529840481c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:01:24.582085 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-67fc4218-d631-488e-949e-02529840481c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:01:24.592447 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-67fc4218-d631-488e-949e-02529840481c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:24.596047 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-67fc4218-d631-488e-949e-02529840481c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:24.596047 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-67fc4218-d631-488e-949e-02529840481c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:24.596047 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-67fc4218-d631-488e-949e-02529840481c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:24.596047 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-67fc4218-d631-488e-949e-02529840481c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:24.596470 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-67fc4218-d631-488e-949e-02529840481c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:24.746910 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-67fc4218-d631-488e-949e-02529840481c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff870e07952c4e049e17a096c477165b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e292a400454c93a48aca5510bfcee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:01:24.755738 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-67fc4218-d631-488e-949e-02529840481c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25" status: 200 len: 1520 microversion: 2.1 time: 0.179029 Sep 16 10:01:24.756758 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 550/1096] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:01:24 2022] GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25 => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:01:24.944525 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-16e9fa08-999c-4db6-bdf9-fe7ff7c91103 req-d015c34a-bfd2-4ec6-be73-edf5f7d050c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34302fd9-9a71-41c1-8392-6b9df5f0f75e", "name": "network-vif-deleted", "tag": "d847971e-055c-4ba7-88f6-3092159ade62"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 10:01:24.957122 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-16e9fa08-999c-4db6-bdf9-fe7ff7c91103 req-d015c34a-bfd2-4ec6-be73-edf5f7d050c8 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:24.957650 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-16e9fa08-999c-4db6-bdf9-fe7ff7c91103 req-d015c34a-bfd2-4ec6-be73-edf5f7d050c8 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:24.958300 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-16e9fa08-999c-4db6-bdf9-fe7ff7c91103 req-d015c34a-bfd2-4ec6-be73-edf5f7d050c8 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:24.974213 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-16e9fa08-999c-4db6-bdf9-fe7ff7c91103 req-d015c34a-bfd2-4ec6-be73-edf5f7d050c8 service nova] Creating event network-vif-deleted:d847971e-055c-4ba7-88f6-3092159ade62 for instance 34302fd9-9a71-41c1-8392-6b9df5f0f75e on hv-cinder-79053 Sep 16 10:01:24.980969 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-16e9fa08-999c-4db6-bdf9-fe7ff7c91103 req-d015c34a-bfd2-4ec6-be73-edf5f7d050c8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109797 Sep 16 10:01:24.981594 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 547/1097] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 10:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 10:01:25.476751 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-d609e649-4718-4c7f-b1ab-e5e049447981 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:01:25.477370 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-d609e649-4718-4c7f-b1ab-e5e049447981 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:01:25.484873 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d609e649-4718-4c7f-b1ab-e5e049447981 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:25.492175 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d609e649-4718-4c7f-b1ab-e5e049447981 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:25.492175 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d609e649-4718-4c7f-b1ab-e5e049447981 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:25.492175 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d609e649-4718-4c7f-b1ab-e5e049447981 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:25.492175 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d609e649-4718-4c7f-b1ab-e5e049447981 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:25.492555 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d609e649-4718-4c7f-b1ab-e5e049447981 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:25.507625 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 10:01:25.521764 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d609e649-4718-4c7f-b1ab-e5e049447981 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:25.522357 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d609e649-4718-4c7f-b1ab-e5e049447981 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:25.523127 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d609e649-4718-4c7f-b1ab-e5e049447981 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:25.523644 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.objects.instance [None req-d609e649-4718-4c7f-b1ab-e5e049447981 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lazy-loading 'fault' on Instance uuid 34302fd9-9a71-41c1-8392-6b9df5f0f75e {{(pid=127671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 10:01:25.588774 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-d609e649-4718-4c7f-b1ab-e5e049447981 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:01:25.602147 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-d609e649-4718-4c7f-b1ab-e5e049447981 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e" status: 200 len: 1328 microversion: 2.1 time: 0.129300 Sep 16 10:01:25.602952 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 551/1098] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:01:25 2022] GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e => generated 1328 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:01:25.781512 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-f68fdfc2-0edf-4237-a4bb-414a46a83c5d tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:01:25.782495 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-f68fdfc2-0edf-4237-a4bb-414a46a83c5d tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:01:25.789387 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f68fdfc2-0edf-4237-a4bb-414a46a83c5d tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:25.789979 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f68fdfc2-0edf-4237-a4bb-414a46a83c5d tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:25.790489 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f68fdfc2-0edf-4237-a4bb-414a46a83c5d tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:25.791293 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f68fdfc2-0edf-4237-a4bb-414a46a83c5d tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:25.791821 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f68fdfc2-0edf-4237-a4bb-414a46a83c5d tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:25.792334 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f68fdfc2-0edf-4237-a4bb-414a46a83c5d tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:26.008517 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f68fdfc2-0edf-4237-a4bb-414a46a83c5d tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff870e07952c4e049e17a096c477165b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e292a400454c93a48aca5510bfcee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:01:26.020862 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-f68fdfc2-0edf-4237-a4bb-414a46a83c5d tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25" status: 200 len: 1576 microversion: 2.1 time: 0.240084 Sep 16 10:01:26.020862 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 548/1099] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:01:25 2022] GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25 => generated 1576 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:01:26.627465 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-a1468dfe-ec26-4be0-8e0f-136d24db0edc tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:01:26.628075 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-a1468dfe-ec26-4be0-8e0f-136d24db0edc tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:01:26.634910 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a1468dfe-ec26-4be0-8e0f-136d24db0edc tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:26.635392 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a1468dfe-ec26-4be0-8e0f-136d24db0edc tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:26.635830 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a1468dfe-ec26-4be0-8e0f-136d24db0edc tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:26.636508 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a1468dfe-ec26-4be0-8e0f-136d24db0edc tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:26.636963 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a1468dfe-ec26-4be0-8e0f-136d24db0edc tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:26.637385 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a1468dfe-ec26-4be0-8e0f-136d24db0edc tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:26.651394 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.wsgi [None req-a1468dfe-ec26-4be0-8e0f-136d24db0edc tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] HTTP exception thrown: Instance 34302fd9-9a71-41c1-8392-6b9df5f0f75e could not be found. Sep 16 10:01:26.653029 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-a1468dfe-ec26-4be0-8e0f-136d24db0edc tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Request method failure captured: Sep 16 10:01:26.653029 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: request: GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e HTTP/1.1 Sep 16 10:01:26.653029 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept: application/json Sep 16 10:01:26.653029 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept-Encoding: identity Sep 16 10:01:26.653029 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Connection: close Sep 16 10:01:26.653029 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Length: 0 Sep 16 10:01:26.653029 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Type: application/json Sep 16 10:01:26.653029 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Host: 10.222.0.73 Sep 16 10:01:26.653029 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Openstack-System-Scope: None Sep 16 10:01:26.653029 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: User-Agent: python-urllib3/1.26.12 Sep 16 10:01:26.653029 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Auth-Token: gAAAAABjJEjLUGfdurvibi0jSt__YF9bN28jjCj46J60KV1MWIbJuT9jV5dbfoguM_hJYDM0C3iVf6V-SEjW3Du4uITfzqCdj3Iiqq4oHbvWrNlWPcHNQZ9r9kW8dpT5uOK4ec2G1gFeu1jjY6MZ0TiA-PlAvs_F4DB2Nb_sHFUo7HfyZvdonQQ Sep 16 10:01:26.653029 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Id: None Sep 16 10:01:26.653029 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Name: None Sep 16 10:01:26.653029 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Identity-Status: Confirmed Sep 16 10:01:26.653029 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Is-Admin-Project: True Sep 16 10:01:26.653029 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Id: default Sep 16 10:01:26.653029 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Name: Default Sep 16 10:01:26.653029 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Id: 75e9f7169b754d5daa040eb465e858e5 Sep 16 10:01:26.653029 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Name: tempest-AttachVolumeTestJSON-104526531 Sep 16 10:01:26.653029 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Role: reader,member Sep 16 10:01:26.653029 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Roles: reader,member Sep 16 10:01:26.654912 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/75e9f7169b754d5daa040eb465e858e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_75e9f7169b754d5daa040eb465e858e5", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/75e9f7169b754d5daa040eb465e858e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/75e9f7169b754d5daa040eb465e858e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 10:01:26.654912 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant: tempest-AttachVolumeTestJSON-104526531 Sep 16 10:01:26.654912 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Id: 75e9f7169b754d5daa040eb465e858e5 Sep 16 10:01:26.654912 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Name: tempest-AttachVolumeTestJSON-104526531 Sep 16 10:01:26.654912 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User: tempest-AttachVolumeTestJSON-104526531-project Sep 16 10:01:26.654912 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Id: default Sep 16 10:01:26.654912 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Name: Default Sep 16 10:01:26.654912 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Id: 6ffd25afbc1b42c995ff96c21221b310 Sep 16 10:01:26.654912 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Name: tempest-AttachVolumeTestJSON-104526531-project Sep 16 10:01:26.654912 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: method: > Sep 16 10:01:26.654912 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: exception: Instance 34302fd9-9a71-41c1-8392-6b9df5f0f75e could not be found. Sep 16 10:01:26.654912 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: action_args: {'id': '34302fd9-9a71-41c1-8392-6b9df5f0f75e'} Sep 16 10:01:26.656123 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 10:01:26.656123 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 10:01:26.656123 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 10:01:26.656123 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 10:01:26.656123 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 10:01:26.656123 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 10:01:26.656123 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 10:01:26.656123 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 10:01:26.656123 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 10:01:26.656123 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 10:01:26.656123 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34302fd9-9a71-41c1-8392-6b9df5f0f75e could not be found. Sep 16 10:01:26.656123 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 10:01:26.656123 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 10:01:26.656123 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 10:01:26.656123 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 10:01:26.656123 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 10:01:26.656123 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 10:01:26.656123 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 10:01:26.656123 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 10:01:26.656123 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 10:01:26.657746 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 10:01:26.657746 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 10:01:26.657746 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 10:01:26.657746 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 10:01:26.657746 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 10:01:26.657746 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 10:01:26.657746 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 10:01:26.657746 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34302fd9-9a71-41c1-8392-6b9df5f0f75e could not be found. Sep 16 10:01:26.657746 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 10:01:26.657746 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 10:01:26.657746 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 10:01:26.657746 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 10:01:26.657746 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 10:01:26.657746 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 10:01:26.657746 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 10:01:26.657746 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 10:01:26.657746 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34302fd9-9a71-41c1-8392-6b9df5f0f75e could not be found. Sep 16 10:01:26.657746 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 10:01:26.659270 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-a1468dfe-ec26-4be0-8e0f-136d24db0edc tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Returning 404 to user: Instance 34302fd9-9a71-41c1-8392-6b9df5f0f75e could not be found. {{(pid=127671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 10:01:26.659270 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-a1468dfe-ec26-4be0-8e0f-136d24db0edc tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e" status: 404 len: 111 microversion: 2.1 time: 0.031640 Sep 16 10:01:26.659270 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 552/1100] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:01:26 2022] GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 10:01:26.664294 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-aac1099c-c882-497b-a600-13a73aef4c6d tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '.version_select at 0x7ffa6dc9ad30>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:01:26.759929 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-aac1099c-c882-497b-a600-13a73aef4c6d tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1110492497" status: 202 len: 0 microversion: 2.1 time: 0.100071 Sep 16 10:01:26.760515 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 549/1101] 10.222.0.73 () {58 vars in 1221 bytes} [Fri Sep 16 10:01:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1110492497 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 10:01:27.040057 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-1f164ffe-1372-4e94-86c7-aaab06dbb0da tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:01:27.043338 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-1f164ffe-1372-4e94-86c7-aaab06dbb0da tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:01:27.048214 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1f164ffe-1372-4e94-86c7-aaab06dbb0da tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:27.048707 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1f164ffe-1372-4e94-86c7-aaab06dbb0da tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:27.049199 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1f164ffe-1372-4e94-86c7-aaab06dbb0da tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:27.049953 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1f164ffe-1372-4e94-86c7-aaab06dbb0da tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:27.050412 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1f164ffe-1372-4e94-86c7-aaab06dbb0da tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:27.050839 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1f164ffe-1372-4e94-86c7-aaab06dbb0da tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:27.183937 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-1f164ffe-1372-4e94-86c7-aaab06dbb0da tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff870e07952c4e049e17a096c477165b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e292a400454c93a48aca5510bfcee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:01:27.191883 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-1f164ffe-1372-4e94-86c7-aaab06dbb0da tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25" status: 200 len: 1576 microversion: 2.1 time: 0.155730 Sep 16 10:01:27.192465 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 553/1102] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:01:27 2022] GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:01:27.548414 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-f19afb6e-2277-4639-b62f-d39867904cde tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Action: 'create', calling method: .version_select at 0x7ffa6dd24040>, body: {"keypair": {"name": "tempest-keypair-1750700227", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQWUq7hla51vaqsqnncCARyJJvBF+yyfh2SAM1MbWZuel9rOTMRjn78sRNMY58/yVj82v4v1PRbgpqOcU85rei0IhOo6T88tD1XGBKY6C+NtfvyuMXFiRJEJsiVSMLeiw=="}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 10:01:27.566158 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-f19afb6e-2277-4639-b62f-d39867904cde tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Getting quotas for project 75e9f7169b754d5daa040eb465e858e5. Resources: {'key_pairs'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 10:01:27.570152 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-f19afb6e-2277-4639-b62f-d39867904cde tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Getting quotas for user 6ffd25afbc1b42c995ff96c21221b310 and project 75e9f7169b754d5daa040eb465e858e5. Resources: {'key_pairs'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 10:01:27.645118 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-f19afb6e-2277-4639-b62f-d39867904cde tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.101358 Sep 16 10:01:27.645755 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 550/1103] 10.222.0.73 () {60 vars in 1159 bytes} [Fri Sep 16 10:01:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 10:01:28.215748 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-2639a751-a23c-47e9-ac35-2af85a7ffe5f tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:01:28.216360 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-2639a751-a23c-47e9-ac35-2af85a7ffe5f tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:01:28.224002 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2639a751-a23c-47e9-ac35-2af85a7ffe5f tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:28.224550 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2639a751-a23c-47e9-ac35-2af85a7ffe5f tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:28.225085 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2639a751-a23c-47e9-ac35-2af85a7ffe5f tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:28.226364 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2639a751-a23c-47e9-ac35-2af85a7ffe5f tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:28.227311 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2639a751-a23c-47e9-ac35-2af85a7ffe5f tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:28.227946 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2639a751-a23c-47e9-ac35-2af85a7ffe5f tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:28.379112 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-2639a751-a23c-47e9-ac35-2af85a7ffe5f tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff870e07952c4e049e17a096c477165b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e292a400454c93a48aca5510bfcee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:01:28.388732 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-2639a751-a23c-47e9-ac35-2af85a7ffe5f tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25" status: 200 len: 1576 microversion: 2.1 time: 0.176926 Sep 16 10:01:28.389453 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 554/1104] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:01:28 2022] GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25 => generated 1576 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:01:29.413030 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-7a0ea7c8-3bce-4571-ab5d-5f74203baeb2 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:01:29.413815 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-7a0ea7c8-3bce-4571-ab5d-5f74203baeb2 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:01:29.419921 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7a0ea7c8-3bce-4571-ab5d-5f74203baeb2 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:29.421122 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7a0ea7c8-3bce-4571-ab5d-5f74203baeb2 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:29.421611 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7a0ea7c8-3bce-4571-ab5d-5f74203baeb2 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:29.422347 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7a0ea7c8-3bce-4571-ab5d-5f74203baeb2 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:29.422807 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7a0ea7c8-3bce-4571-ab5d-5f74203baeb2 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:29.423226 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-7a0ea7c8-3bce-4571-ab5d-5f74203baeb2 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:29.582011 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-7a0ea7c8-3bce-4571-ab5d-5f74203baeb2 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff870e07952c4e049e17a096c477165b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e292a400454c93a48aca5510bfcee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:01:29.589678 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-7a0ea7c8-3bce-4571-ab5d-5f74203baeb2 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25" status: 200 len: 1576 microversion: 2.1 time: 0.181206 Sep 16 10:01:29.590252 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 551/1105] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:01:29 2022] GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25 => generated 1576 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:01:29.840347 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-a8a22c74-5b22-481b-b8a2-5d737e7aa156 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1216201114", "imageRef": "30d28050-ec9d-4227-9bb0-5247430f6177", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0c5fa5a7-17b8-41e4-80c7-74693b744506"}], "security_groups": [{"name": "tempest-securitygroup--1009878639"}], "key_name": "tempest-keypair-1750700227", "user_data": "}} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 10:01:29.943815 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.network.neutron [None req-a8a22c74-5b22-481b-b8a2-5d737e7aa156 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] validate_networks() for [('0c5fa5a7-17b8-41e4-80c7-74693b744506', None, None, None, None, None)] {{(pid=127671) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 10:01:30.317109 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.virt.hardware [None req-a8a22c74-5b22-481b-b8a2-5d737e7aa156 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Flavor limits 0:0:0 {{(pid=127671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 10:01:30.317564 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.virt.hardware [None req-a8a22c74-5b22-481b-b8a2-5d737e7aa156 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Image limits 0:0:0 {{(pid=127671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 10:01:30.318049 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.virt.hardware [None req-a8a22c74-5b22-481b-b8a2-5d737e7aa156 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Flavor pref 0:0:0 {{(pid=127671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 10:01:30.318467 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.virt.hardware [None req-a8a22c74-5b22-481b-b8a2-5d737e7aa156 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Image pref 0:0:0 {{(pid=127671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 10:01:30.318888 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.virt.hardware [None req-a8a22c74-5b22-481b-b8a2-5d737e7aa156 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 10:01:30.328664 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a8a22c74-5b22-481b-b8a2-5d737e7aa156 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:30.329156 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a8a22c74-5b22-481b-b8a2-5d737e7aa156 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:30.329636 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a8a22c74-5b22-481b-b8a2-5d737e7aa156 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:30.330378 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a8a22c74-5b22-481b-b8a2-5d737e7aa156 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:30.330843 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a8a22c74-5b22-481b-b8a2-5d737e7aa156 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:30.331276 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a8a22c74-5b22-481b-b8a2-5d737e7aa156 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:30.348289 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.quota [None req-a8a22c74-5b22-481b-b8a2-5d737e7aa156 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Getting quotas for project 75e9f7169b754d5daa040eb465e858e5. Resources: {'instances', 'cores', 'ram'} {{(pid=127671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 10:01:30.352282 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.quota [None req-a8a22c74-5b22-481b-b8a2-5d737e7aa156 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Getting quotas for user 6ffd25afbc1b42c995ff96c21221b310 and project 75e9f7169b754d5daa040eb465e858e5. Resources: {'instances', 'cores', 'ram'} {{(pid=127671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 10:01:30.363476 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-a8a22c74-5b22-481b-b8a2-5d737e7aa156 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Going to run 1 instances... {{(pid=127671) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 10:01:30.365779 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-a8a22c74-5b22-481b-b8a2-5d737e7aa156 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 0dbcc0d7-d447-42d4-8a11-cdb458c0a697] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='30d28050-ec9d-4227-9bb0-5247430f6177',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 10:01:30.463928 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-a8a22c74-5b22-481b-b8a2-5d737e7aa156 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.627791 Sep 16 10:01:30.466049 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 555/1106] 10.222.0.73 () {60 vars in 1147 bytes} [Fri Sep 16 10:01:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 10:01:30.476110 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-11fa9f3f-24e4-4de7-877e-091482a41bfb tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:01:30.476737 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-11fa9f3f-24e4-4de7-877e-091482a41bfb tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 0dbcc0d7-d447-42d4-8a11-cdb458c0a697] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:01:30.530812 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-11fa9f3f-24e4-4de7-877e-091482a41bfb tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:01:30.537555 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-11fa9f3f-24e4-4de7-877e-091482a41bfb tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697" status: 200 len: 1238 microversion: 2.1 time: 0.065280 Sep 16 10:01:30.538129 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 552/1107] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:01:30 2022] GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697 => generated 1238 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:01:30.613185 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-d56b3ecf-21da-4618-8e1a-af80177aed69 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:01:30.613826 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-d56b3ecf-21da-4618-8e1a-af80177aed69 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:01:30.619872 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d56b3ecf-21da-4618-8e1a-af80177aed69 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:30.620360 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d56b3ecf-21da-4618-8e1a-af80177aed69 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:30.620832 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d56b3ecf-21da-4618-8e1a-af80177aed69 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:30.622239 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d56b3ecf-21da-4618-8e1a-af80177aed69 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:30.622859 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d56b3ecf-21da-4618-8e1a-af80177aed69 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:30.623304 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d56b3ecf-21da-4618-8e1a-af80177aed69 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:30.757517 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-d56b3ecf-21da-4618-8e1a-af80177aed69 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff870e07952c4e049e17a096c477165b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e292a400454c93a48aca5510bfcee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:01:30.766211 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-d56b3ecf-21da-4618-8e1a-af80177aed69 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25" status: 200 len: 1576 microversion: 2.1 time: 0.156827 Sep 16 10:01:30.773708 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 556/1108] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:01:30 2022] GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:01:31.560567 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d9870561-e55e-4908-94b1-8ee285bb9c70 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:01:31.561317 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-d9870561-e55e-4908-94b1-8ee285bb9c70 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 0dbcc0d7-d447-42d4-8a11-cdb458c0a697] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:01:31.568619 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d9870561-e55e-4908-94b1-8ee285bb9c70 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:31.573170 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d9870561-e55e-4908-94b1-8ee285bb9c70 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:31.573170 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d9870561-e55e-4908-94b1-8ee285bb9c70 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:31.573170 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d9870561-e55e-4908-94b1-8ee285bb9c70 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:31.573170 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d9870561-e55e-4908-94b1-8ee285bb9c70 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:31.573622 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d9870561-e55e-4908-94b1-8ee285bb9c70 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:31.631555 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-d9870561-e55e-4908-94b1-8ee285bb9c70 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:01:31.640006 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-d9870561-e55e-4908-94b1-8ee285bb9c70 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697" status: 200 len: 1242 microversion: 2.1 time: 0.082654 Sep 16 10:01:31.640615 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 553/1109] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:01:31 2022] GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697 => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:01:31.789804 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-5b6d93a6-ff99-4064-bef4-761c0c68b008 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:01:31.790441 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-5b6d93a6-ff99-4064-bef4-761c0c68b008 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:01:31.797686 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5b6d93a6-ff99-4064-bef4-761c0c68b008 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:31.806165 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5b6d93a6-ff99-4064-bef4-761c0c68b008 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:31.806165 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5b6d93a6-ff99-4064-bef4-761c0c68b008 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:31.806165 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5b6d93a6-ff99-4064-bef4-761c0c68b008 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:31.806165 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5b6d93a6-ff99-4064-bef4-761c0c68b008 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:31.806559 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-5b6d93a6-ff99-4064-bef4-761c0c68b008 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:31.929933 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-5b6d93a6-ff99-4064-bef4-761c0c68b008 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff870e07952c4e049e17a096c477165b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e292a400454c93a48aca5510bfcee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:01:31.937613 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-5b6d93a6-ff99-4064-bef4-761c0c68b008 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25" status: 200 len: 1576 microversion: 2.1 time: 0.151707 Sep 16 10:01:31.938208 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 557/1110] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:01:31 2022] GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:01:32.664085 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-686e6417-a99e-4029-b699-edbab6d4c1ad tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:01:32.664688 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-686e6417-a99e-4029-b699-edbab6d4c1ad tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 0dbcc0d7-d447-42d4-8a11-cdb458c0a697] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:01:32.671849 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-686e6417-a99e-4029-b699-edbab6d4c1ad tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:32.672348 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-686e6417-a99e-4029-b699-edbab6d4c1ad tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:32.672797 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-686e6417-a99e-4029-b699-edbab6d4c1ad tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:32.673499 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-686e6417-a99e-4029-b699-edbab6d4c1ad tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:32.673990 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-686e6417-a99e-4029-b699-edbab6d4c1ad tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:32.674450 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-686e6417-a99e-4029-b699-edbab6d4c1ad tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:32.678517 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 10:01:32.738018 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-686e6417-a99e-4029-b699-edbab6d4c1ad tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:01:32.745633 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-686e6417-a99e-4029-b699-edbab6d4c1ad tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697" status: 200 len: 1290 microversion: 2.1 time: 0.085745 Sep 16 10:01:32.746205 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 554/1111] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:01:32 2022] GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697 => generated 1290 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:01:32.960507 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-61b877b7-19eb-4938-a57b-4a63a994116c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:01:32.961835 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-61b877b7-19eb-4938-a57b-4a63a994116c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:01:32.963816 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 10:01:32.963961 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Fri Sep 16 10:01:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25 (ip 10.222.0.73) !!! Sep 16 10:01:32.976174 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-61b877b7-19eb-4938-a57b-4a63a994116c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:32.976662 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-61b877b7-19eb-4938-a57b-4a63a994116c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:32.977096 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-61b877b7-19eb-4938-a57b-4a63a994116c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:32.978097 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-61b877b7-19eb-4938-a57b-4a63a994116c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:32.978400 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-61b877b7-19eb-4938-a57b-4a63a994116c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:32.978830 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-61b877b7-19eb-4938-a57b-4a63a994116c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:33.117737 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-61b877b7-19eb-4938-a57b-4a63a994116c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff870e07952c4e049e17a096c477165b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e292a400454c93a48aca5510bfcee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:01:33.127437 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-61b877b7-19eb-4938-a57b-4a63a994116c tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25" status: 200 len: 1576 microversion: 2.1 time: 0.170979 Sep 16 10:01:33.141572 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 558/1112] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:01:32 2022] GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25 => generated 1576 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:01:33.769482 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-16400eeb-7729-4d1a-9b01-f28176e56737 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:01:33.770162 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-16400eeb-7729-4d1a-9b01-f28176e56737 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 0dbcc0d7-d447-42d4-8a11-cdb458c0a697] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:01:33.777484 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-16400eeb-7729-4d1a-9b01-f28176e56737 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:33.777993 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-16400eeb-7729-4d1a-9b01-f28176e56737 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:33.778428 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-16400eeb-7729-4d1a-9b01-f28176e56737 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:33.779226 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-16400eeb-7729-4d1a-9b01-f28176e56737 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:33.779916 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-16400eeb-7729-4d1a-9b01-f28176e56737 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:33.780355 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-16400eeb-7729-4d1a-9b01-f28176e56737 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:33.988064 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-16400eeb-7729-4d1a-9b01-f28176e56737 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:01:33.995912 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-16400eeb-7729-4d1a-9b01-f28176e56737 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697" status: 200 len: 1364 microversion: 2.1 time: 0.230242 Sep 16 10:01:33.997668 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 555/1113] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:01:33 2022] GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697 => generated 1364 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:01:34.151339 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-383b94ca-047f-4ab9-bb22-568f379d76ff tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:01:34.151885 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-383b94ca-047f-4ab9-bb22-568f379d76ff tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:01:34.158753 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-383b94ca-047f-4ab9-bb22-568f379d76ff tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:34.159253 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-383b94ca-047f-4ab9-bb22-568f379d76ff tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:34.159697 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-383b94ca-047f-4ab9-bb22-568f379d76ff tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:34.160431 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-383b94ca-047f-4ab9-bb22-568f379d76ff tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:34.160895 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-383b94ca-047f-4ab9-bb22-568f379d76ff tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:34.161324 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-383b94ca-047f-4ab9-bb22-568f379d76ff tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:34.300238 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-383b94ca-047f-4ab9-bb22-568f379d76ff tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff870e07952c4e049e17a096c477165b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e292a400454c93a48aca5510bfcee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:01:34.308263 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-383b94ca-047f-4ab9-bb22-568f379d76ff tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25" status: 200 len: 1576 microversion: 2.1 time: 0.161037 Sep 16 10:01:34.308974 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 559/1114] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:01:34 2022] GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:01:34.690460 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-cea2ec52-ab4a-491d-9650-c8de619dfa89 req-cdad1842-f4c9-4903-8dd6-009bfdba63ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dbcc0d7-d447-42d4-8a11-cdb458c0a697", "tag": "97cdb95d-619a-43b7-bb59-0593c39fa45d"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 10:01:34.700160 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-cea2ec52-ab4a-491d-9650-c8de619dfa89 req-cdad1842-f4c9-4903-8dd6-009bfdba63ff service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:34.700643 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-cea2ec52-ab4a-491d-9650-c8de619dfa89 req-cdad1842-f4c9-4903-8dd6-009bfdba63ff service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:34.701150 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-cea2ec52-ab4a-491d-9650-c8de619dfa89 req-cdad1842-f4c9-4903-8dd6-009bfdba63ff service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:34.713392 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-cea2ec52-ab4a-491d-9650-c8de619dfa89 req-cdad1842-f4c9-4903-8dd6-009bfdba63ff service nova] Creating event network-changed:97cdb95d-619a-43b7-bb59-0593c39fa45d for instance 0dbcc0d7-d447-42d4-8a11-cdb458c0a697 on hv-cinder-79053 Sep 16 10:01:34.718961 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-cea2ec52-ab4a-491d-9650-c8de619dfa89 req-cdad1842-f4c9-4903-8dd6-009bfdba63ff service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033019 Sep 16 10:01:34.719722 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 556/1115] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 10:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 10:01:35.021049 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-2b80371d-736a-4fd1-9832-9097319bcb34 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:01:35.021974 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-2b80371d-736a-4fd1-9832-9097319bcb34 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 0dbcc0d7-d447-42d4-8a11-cdb458c0a697] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:01:35.028036 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2b80371d-736a-4fd1-9832-9097319bcb34 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:35.028537 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2b80371d-736a-4fd1-9832-9097319bcb34 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:35.028987 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2b80371d-736a-4fd1-9832-9097319bcb34 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:35.032046 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2b80371d-736a-4fd1-9832-9097319bcb34 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:35.032530 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2b80371d-736a-4fd1-9832-9097319bcb34 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:35.033498 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2b80371d-736a-4fd1-9832-9097319bcb34 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:35.182083 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-2b80371d-736a-4fd1-9832-9097319bcb34 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:01:35.194378 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-2b80371d-736a-4fd1-9832-9097319bcb34 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697" status: 200 len: 1364 microversion: 2.1 time: 0.174757 Sep 16 10:01:35.194378 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 560/1116] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:01:35 2022] GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697 => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:01:35.332737 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-60c40b2c-747d-4d31-8167-09e6ca5b5d15 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:01:35.333632 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-60c40b2c-747d-4d31-8167-09e6ca5b5d15 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:01:35.341829 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-60c40b2c-747d-4d31-8167-09e6ca5b5d15 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:35.343418 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-60c40b2c-747d-4d31-8167-09e6ca5b5d15 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:35.343689 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-60c40b2c-747d-4d31-8167-09e6ca5b5d15 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:35.344341 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-60c40b2c-747d-4d31-8167-09e6ca5b5d15 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:35.344817 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-60c40b2c-747d-4d31-8167-09e6ca5b5d15 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:35.345257 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-60c40b2c-747d-4d31-8167-09e6ca5b5d15 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:35.505718 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-60c40b2c-747d-4d31-8167-09e6ca5b5d15 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff870e07952c4e049e17a096c477165b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e292a400454c93a48aca5510bfcee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:01:35.513894 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-60c40b2c-747d-4d31-8167-09e6ca5b5d15 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25" status: 200 len: 1576 microversion: 2.1 time: 0.185756 Sep 16 10:01:35.514516 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 557/1117] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:01:35 2022] GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25 => generated 1576 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:01:36.214907 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-e980a712-8bb4-4c66-a929-9f4da6ed190d tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:01:36.215456 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-e980a712-8bb4-4c66-a929-9f4da6ed190d tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 0dbcc0d7-d447-42d4-8a11-cdb458c0a697] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:01:36.217899 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 10:01:36.223017 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e980a712-8bb4-4c66-a929-9f4da6ed190d tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:36.223502 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e980a712-8bb4-4c66-a929-9f4da6ed190d tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:36.223943 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e980a712-8bb4-4c66-a929-9f4da6ed190d tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:36.224638 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e980a712-8bb4-4c66-a929-9f4da6ed190d tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:36.225123 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e980a712-8bb4-4c66-a929-9f4da6ed190d tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:36.225605 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e980a712-8bb4-4c66-a929-9f4da6ed190d tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:36.365812 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-e980a712-8bb4-4c66-a929-9f4da6ed190d tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:01:36.374021 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-e980a712-8bb4-4c66-a929-9f4da6ed190d tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697" status: 200 len: 1364 microversion: 2.1 time: 0.162442 Sep 16 10:01:36.374583 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 561/1118] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:01:36 2022] GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:01:36.536671 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-527b35de-064e-483a-ac9b-3e711c6eee16 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:01:36.537210 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-527b35de-064e-483a-ac9b-3e711c6eee16 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:01:36.539654 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 10:01:36.544310 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-527b35de-064e-483a-ac9b-3e711c6eee16 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:36.544790 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-527b35de-064e-483a-ac9b-3e711c6eee16 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:36.545302 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-527b35de-064e-483a-ac9b-3e711c6eee16 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:36.546027 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-527b35de-064e-483a-ac9b-3e711c6eee16 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:36.546478 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-527b35de-064e-483a-ac9b-3e711c6eee16 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:36.562089 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-527b35de-064e-483a-ac9b-3e711c6eee16 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:36.677963 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-527b35de-064e-483a-ac9b-3e711c6eee16 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff870e07952c4e049e17a096c477165b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e292a400454c93a48aca5510bfcee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:01:36.686881 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-527b35de-064e-483a-ac9b-3e711c6eee16 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25" status: 200 len: 1576 microversion: 2.1 time: 0.153376 Sep 16 10:01:36.687512 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 558/1119] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:01:36 2022] GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:01:37.282286 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [req-ff1c2be3-0046-43ac-8dc4-4a453ea8de8b req-7c4c7281-a4e0-40d6-a523-4a6571add655 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70372e0b-76cc-4156-84ae-3734dd9f7b25", "name": "network-vif-plugged", "status": "completed", "tag": "cc7b6bd5-7e7c-4cc5-8097-75cfcd4c3ad8"}]} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 10:01:37.291626 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-ff1c2be3-0046-43ac-8dc4-4a453ea8de8b req-7c4c7281-a4e0-40d6-a523-4a6571add655 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:37.292096 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-ff1c2be3-0046-43ac-8dc4-4a453ea8de8b req-7c4c7281-a4e0-40d6-a523-4a6571add655 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:37.292523 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-ff1c2be3-0046-43ac-8dc4-4a453ea8de8b req-7c4c7281-a4e0-40d6-a523-4a6571add655 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:37.303117 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.compute.server_external_events [req-ff1c2be3-0046-43ac-8dc4-4a453ea8de8b req-7c4c7281-a4e0-40d6-a523-4a6571add655 service nova] Creating event network-vif-plugged:cc7b6bd5-7e7c-4cc5-8097-75cfcd4c3ad8 for instance 70372e0b-76cc-4156-84ae-3734dd9f7b25 on hv-cinder-79053 Sep 16 10:01:37.308168 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [req-ff1c2be3-0046-43ac-8dc4-4a453ea8de8b req-7c4c7281-a4e0-40d6-a523-4a6571add655 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087457 Sep 16 10:01:37.316189 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 562/1120] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 10:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 10:01:37.396418 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-c22b7f16-e26f-4652-932b-b6bc7b052426 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:01:37.397068 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-c22b7f16-e26f-4652-932b-b6bc7b052426 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 0dbcc0d7-d447-42d4-8a11-cdb458c0a697] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:01:37.403022 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c22b7f16-e26f-4652-932b-b6bc7b052426 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:37.407860 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c22b7f16-e26f-4652-932b-b6bc7b052426 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:37.407860 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c22b7f16-e26f-4652-932b-b6bc7b052426 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:37.407860 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c22b7f16-e26f-4652-932b-b6bc7b052426 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:37.407860 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c22b7f16-e26f-4652-932b-b6bc7b052426 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:37.408349 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c22b7f16-e26f-4652-932b-b6bc7b052426 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:37.544544 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c22b7f16-e26f-4652-932b-b6bc7b052426 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:01:37.552526 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-c22b7f16-e26f-4652-932b-b6bc7b052426 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697" status: 200 len: 1364 microversion: 2.1 time: 0.160044 Sep 16 10:01:37.553101 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 559/1121] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:01:37 2022] GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:01:37.710767 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-c03db0a8-fe5d-4396-a1cd-ad52203c1e84 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:01:37.711459 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-c03db0a8-fe5d-4396-a1cd-ad52203c1e84 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:01:37.718153 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c03db0a8-fe5d-4396-a1cd-ad52203c1e84 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:37.718632 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c03db0a8-fe5d-4396-a1cd-ad52203c1e84 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:37.719072 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c03db0a8-fe5d-4396-a1cd-ad52203c1e84 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:37.719757 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c03db0a8-fe5d-4396-a1cd-ad52203c1e84 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:37.720208 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c03db0a8-fe5d-4396-a1cd-ad52203c1e84 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:37.720900 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c03db0a8-fe5d-4396-a1cd-ad52203c1e84 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:37.848074 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-c03db0a8-fe5d-4396-a1cd-ad52203c1e84 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff870e07952c4e049e17a096c477165b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e292a400454c93a48aca5510bfcee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:01:37.855635 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-c03db0a8-fe5d-4396-a1cd-ad52203c1e84 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25" status: 200 len: 1576 microversion: 2.1 time: 0.149116 Sep 16 10:01:37.856192 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 563/1122] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:01:37 2022] GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:01:38.574945 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-ec691e99-8a07-43fd-8d7b-94af93c43118 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:01:38.575571 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-ec691e99-8a07-43fd-8d7b-94af93c43118 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 0dbcc0d7-d447-42d4-8a11-cdb458c0a697] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:01:38.582272 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ec691e99-8a07-43fd-8d7b-94af93c43118 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:38.582761 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ec691e99-8a07-43fd-8d7b-94af93c43118 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:38.583201 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ec691e99-8a07-43fd-8d7b-94af93c43118 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:38.583896 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ec691e99-8a07-43fd-8d7b-94af93c43118 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:38.584355 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ec691e99-8a07-43fd-8d7b-94af93c43118 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:38.584784 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ec691e99-8a07-43fd-8d7b-94af93c43118 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:38.718610 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-ec691e99-8a07-43fd-8d7b-94af93c43118 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:01:38.726506 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-ec691e99-8a07-43fd-8d7b-94af93c43118 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697" status: 200 len: 1364 microversion: 2.1 time: 0.155488 Sep 16 10:01:38.727187 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 560/1123] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:01:38 2022] GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:01:38.879625 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-c3dcddea-0937-4915-9185-00aa3860d191 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:01:38.880205 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-c3dcddea-0937-4915-9185-00aa3860d191 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:01:38.886687 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c3dcddea-0937-4915-9185-00aa3860d191 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:38.887171 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c3dcddea-0937-4915-9185-00aa3860d191 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:38.887609 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c3dcddea-0937-4915-9185-00aa3860d191 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:38.888297 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c3dcddea-0937-4915-9185-00aa3860d191 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:38.889763 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c3dcddea-0937-4915-9185-00aa3860d191 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:38.890226 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c3dcddea-0937-4915-9185-00aa3860d191 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:39.021476 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-c3dcddea-0937-4915-9185-00aa3860d191 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff870e07952c4e049e17a096c477165b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e292a400454c93a48aca5510bfcee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:01:39.029279 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-c3dcddea-0937-4915-9185-00aa3860d191 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25" status: 200 len: 1576 microversion: 2.1 time: 0.153684 Sep 16 10:01:39.030513 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 564/1124] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:01:38 2022] GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:01:39.750655 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-91bee27a-0f5f-431a-82f0-ff5331a9ceae tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:01:39.751221 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-91bee27a-0f5f-431a-82f0-ff5331a9ceae tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 0dbcc0d7-d447-42d4-8a11-cdb458c0a697] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:01:39.757845 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-91bee27a-0f5f-431a-82f0-ff5331a9ceae tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:39.758333 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-91bee27a-0f5f-431a-82f0-ff5331a9ceae tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:39.758782 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-91bee27a-0f5f-431a-82f0-ff5331a9ceae tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:39.759476 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-91bee27a-0f5f-431a-82f0-ff5331a9ceae tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:39.759937 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-91bee27a-0f5f-431a-82f0-ff5331a9ceae tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:39.760370 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-91bee27a-0f5f-431a-82f0-ff5331a9ceae tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:39.888538 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-91bee27a-0f5f-431a-82f0-ff5331a9ceae tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:01:39.896843 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-91bee27a-0f5f-431a-82f0-ff5331a9ceae tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697" status: 200 len: 1364 microversion: 2.1 time: 0.150752 Sep 16 10:01:39.897414 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 561/1125] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:01:39 2022] GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:01:40.052933 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-6209fb7f-1c8b-4966-beb4-e059dcc9d8f6 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:01:40.053468 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-6209fb7f-1c8b-4966-beb4-e059dcc9d8f6 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:01:40.059905 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6209fb7f-1c8b-4966-beb4-e059dcc9d8f6 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:40.060383 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6209fb7f-1c8b-4966-beb4-e059dcc9d8f6 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:40.061521 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6209fb7f-1c8b-4966-beb4-e059dcc9d8f6 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:40.062230 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6209fb7f-1c8b-4966-beb4-e059dcc9d8f6 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:40.062684 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6209fb7f-1c8b-4966-beb4-e059dcc9d8f6 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:40.063107 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-6209fb7f-1c8b-4966-beb4-e059dcc9d8f6 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:40.194660 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-6209fb7f-1c8b-4966-beb4-e059dcc9d8f6 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff870e07952c4e049e17a096c477165b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e292a400454c93a48aca5510bfcee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:01:40.203100 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-6209fb7f-1c8b-4966-beb4-e059dcc9d8f6 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25" status: 200 len: 1563 microversion: 2.1 time: 0.154046 Sep 16 10:01:40.203674 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 565/1126] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:01:40 2022] GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:01:40.920238 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-69134f69-fc4f-4a0c-90fd-848e3fca2f60 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:01:40.920863 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-69134f69-fc4f-4a0c-90fd-848e3fca2f60 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 0dbcc0d7-d447-42d4-8a11-cdb458c0a697] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:01:40.922746 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell0:SELECT=6 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 10:01:40.927992 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-69134f69-fc4f-4a0c-90fd-848e3fca2f60 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:40.928483 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-69134f69-fc4f-4a0c-90fd-848e3fca2f60 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:40.934339 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-69134f69-fc4f-4a0c-90fd-848e3fca2f60 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:40.934339 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-69134f69-fc4f-4a0c-90fd-848e3fca2f60 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:40.934339 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-69134f69-fc4f-4a0c-90fd-848e3fca2f60 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:40.934339 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-69134f69-fc4f-4a0c-90fd-848e3fca2f60 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:41.064373 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-69134f69-fc4f-4a0c-90fd-848e3fca2f60 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:01:41.072333 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-69134f69-fc4f-4a0c-90fd-848e3fca2f60 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697" status: 200 len: 1364 microversion: 2.1 time: 0.156131 Sep 16 10:01:41.072911 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 562/1127] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:01:40 2022] GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:01:41.294192 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [req-9354d257-a262-499f-9be8-9b846eb7bf2d req-a97dd4e8-8b88-4970-a345-3af9421e6508 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dbcc0d7-d447-42d4-8a11-cdb458c0a697", "name": "network-vif-plugged", "status": "completed", "tag": "97cdb95d-619a-43b7-bb59-0593c39fa45d"}]} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 10:01:41.299919 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell0:SELECT=2 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 10:01:41.300546 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell0:SELECT=6 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 10:01:41.306460 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-9354d257-a262-499f-9be8-9b846eb7bf2d req-a97dd4e8-8b88-4970-a345-3af9421e6508 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:41.306947 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-9354d257-a262-499f-9be8-9b846eb7bf2d req-a97dd4e8-8b88-4970-a345-3af9421e6508 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:41.307385 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-9354d257-a262-499f-9be8-9b846eb7bf2d req-a97dd4e8-8b88-4970-a345-3af9421e6508 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:41.318900 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.compute.server_external_events [req-9354d257-a262-499f-9be8-9b846eb7bf2d req-a97dd4e8-8b88-4970-a345-3af9421e6508 service nova] Creating event network-vif-plugged:97cdb95d-619a-43b7-bb59-0593c39fa45d for instance 0dbcc0d7-d447-42d4-8a11-cdb458c0a697 on hv-cinder-79053 Sep 16 10:01:41.324042 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [req-9354d257-a262-499f-9be8-9b846eb7bf2d req-a97dd4e8-8b88-4970-a345-3af9421e6508 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033617 Sep 16 10:01:41.324658 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 566/1128] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 10:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 10:01:42.096844 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-b4590572-f66a-454c-b487-c073863d52a3 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:01:42.097470 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-b4590572-f66a-454c-b487-c073863d52a3 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 0dbcc0d7-d447-42d4-8a11-cdb458c0a697] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:01:42.103893 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b4590572-f66a-454c-b487-c073863d52a3 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:42.104384 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b4590572-f66a-454c-b487-c073863d52a3 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:42.104826 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b4590572-f66a-454c-b487-c073863d52a3 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:42.105519 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b4590572-f66a-454c-b487-c073863d52a3 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:42.106005 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b4590572-f66a-454c-b487-c073863d52a3 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:42.106435 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b4590572-f66a-454c-b487-c073863d52a3 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:42.233593 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-b4590572-f66a-454c-b487-c073863d52a3 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:01:42.241118 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-b4590572-f66a-454c-b487-c073863d52a3 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697" status: 200 len: 1364 microversion: 2.1 time: 0.149266 Sep 16 10:01:42.241781 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 563/1129] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:01:42 2022] GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:01:43.265991 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-8a37de3c-f489-4a9e-a917-8ee307168cf4 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:01:43.266712 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-8a37de3c-f489-4a9e-a917-8ee307168cf4 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 0dbcc0d7-d447-42d4-8a11-cdb458c0a697] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:01:43.275245 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8a37de3c-f489-4a9e-a917-8ee307168cf4 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:43.276019 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8a37de3c-f489-4a9e-a917-8ee307168cf4 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:43.276463 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8a37de3c-f489-4a9e-a917-8ee307168cf4 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:43.277161 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8a37de3c-f489-4a9e-a917-8ee307168cf4 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:43.277868 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8a37de3c-f489-4a9e-a917-8ee307168cf4 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:43.279022 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8a37de3c-f489-4a9e-a917-8ee307168cf4 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:43.428274 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-8a37de3c-f489-4a9e-a917-8ee307168cf4 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:01:43.436495 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-8a37de3c-f489-4a9e-a917-8ee307168cf4 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697" status: 200 len: 1364 microversion: 2.1 time: 0.175973 Sep 16 10:01:43.437320 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 567/1130] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:01:43 2022] GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697 => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:01:44.459565 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-b6d8e1d6-163b-44c9-8360-1b2da16fff95 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:01:44.460192 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-b6d8e1d6-163b-44c9-8360-1b2da16fff95 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 0dbcc0d7-d447-42d4-8a11-cdb458c0a697] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:01:44.467215 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b6d8e1d6-163b-44c9-8360-1b2da16fff95 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:44.467875 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b6d8e1d6-163b-44c9-8360-1b2da16fff95 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:44.468144 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b6d8e1d6-163b-44c9-8360-1b2da16fff95 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:44.468847 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b6d8e1d6-163b-44c9-8360-1b2da16fff95 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:44.469308 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b6d8e1d6-163b-44c9-8360-1b2da16fff95 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:44.469800 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b6d8e1d6-163b-44c9-8360-1b2da16fff95 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:44.596870 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-b6d8e1d6-163b-44c9-8360-1b2da16fff95 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:01:44.604570 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-b6d8e1d6-163b-44c9-8360-1b2da16fff95 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697" status: 200 len: 1550 microversion: 2.1 time: 0.148881 Sep 16 10:01:44.605146 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 564/1131] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:01:44 2022] GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697 => generated 1550 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:01:44.628247 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-96e5df25-d676-4b6b-bb9c-75bb050b0629 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:01:44.628752 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-96e5df25-d676-4b6b-bb9c-75bb050b0629 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 0dbcc0d7-d447-42d4-8a11-cdb458c0a697] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:01:44.635128 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-96e5df25-d676-4b6b-bb9c-75bb050b0629 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:44.635616 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-96e5df25-d676-4b6b-bb9c-75bb050b0629 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:44.636068 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-96e5df25-d676-4b6b-bb9c-75bb050b0629 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:44.636764 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-96e5df25-d676-4b6b-bb9c-75bb050b0629 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:44.637227 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-96e5df25-d676-4b6b-bb9c-75bb050b0629 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:44.637699 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-96e5df25-d676-4b6b-bb9c-75bb050b0629 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:44.718790 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-96e5df25-d676-4b6b-bb9c-75bb050b0629 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094257 Sep 16 10:01:44.719412 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 568/1132] 10.222.0.73 () {58 vars in 1275 bytes} [Fri Sep 16 10:01:44 2022] GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 10:01:45.913952 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-37677155-b55f-4e03-a9c5-d7d14a043fc7 req-ea8f9c84-58a5-4165-9d45-bbd4c28c4dc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dbcc0d7-d447-42d4-8a11-cdb458c0a697", "tag": "97cdb95d-619a-43b7-bb59-0593c39fa45d"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 10:01:45.923990 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-37677155-b55f-4e03-a9c5-d7d14a043fc7 req-ea8f9c84-58a5-4165-9d45-bbd4c28c4dc4 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:01:45.924558 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-37677155-b55f-4e03-a9c5-d7d14a043fc7 req-ea8f9c84-58a5-4165-9d45-bbd4c28c4dc4 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:01:45.925090 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-37677155-b55f-4e03-a9c5-d7d14a043fc7 req-ea8f9c84-58a5-4165-9d45-bbd4c28c4dc4 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:01:45.938879 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-37677155-b55f-4e03-a9c5-d7d14a043fc7 req-ea8f9c84-58a5-4165-9d45-bbd4c28c4dc4 service nova] Creating event network-changed:97cdb95d-619a-43b7-bb59-0593c39fa45d for instance 0dbcc0d7-d447-42d4-8a11-cdb458c0a697 on hv-cinder-79053 Sep 16 10:01:45.944104 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-37677155-b55f-4e03-a9c5-d7d14a043fc7 req-ea8f9c84-58a5-4165-9d45-bbd4c28c4dc4 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034012 Sep 16 10:01:45.944913 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 565/1133] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 10:01:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 10:02:21.831513 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_api:SELECT=15 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 10:02:21.832262 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell1:SELECT=88 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 10:02:21.836793 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-c6a5ffaa-bc49-4637-8290-59afd500aec6 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:02:21.837282 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-c6a5ffaa-bc49-4637-8290-59afd500aec6 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 0dbcc0d7-d447-42d4-8a11-cdb458c0a697] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:02:21.843038 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c6a5ffaa-bc49-4637-8290-59afd500aec6 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:21.847706 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c6a5ffaa-bc49-4637-8290-59afd500aec6 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:21.847706 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c6a5ffaa-bc49-4637-8290-59afd500aec6 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:21.847706 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c6a5ffaa-bc49-4637-8290-59afd500aec6 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:21.847706 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c6a5ffaa-bc49-4637-8290-59afd500aec6 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:21.848263 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c6a5ffaa-bc49-4637-8290-59afd500aec6 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:21.870957 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-c6a5ffaa-bc49-4637-8290-59afd500aec6 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697/ips" status: 200 len: 145 microversion: 2.1 time: 0.040951 Sep 16 10:02:21.871508 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 569/1134] 10.222.0.73 () {58 vars in 1248 bytes} [Fri Sep 16 10:02:21 2022] GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697/ips => generated 145 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 10:02:23.519097 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-f9c6bdc0-5fdb-4f5f-a581-af997887a6fe tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "14f6ef3c-c897-44b5-a727-de340aa88ac2"}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 10:02:23.521558 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-f9c6bdc0-5fdb-4f5f-a581-af997887a6fe tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 0dbcc0d7-d447-42d4-8a11-cdb458c0a697] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:02:23.524062 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_api:SELECT=15 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 10:02:23.524720 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=62 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 10:02:23.529645 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f9c6bdc0-5fdb-4f5f-a581-af997887a6fe tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:23.530145 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f9c6bdc0-5fdb-4f5f-a581-af997887a6fe tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:23.530590 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f9c6bdc0-5fdb-4f5f-a581-af997887a6fe tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:23.531372 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f9c6bdc0-5fdb-4f5f-a581-af997887a6fe tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:23.531836 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f9c6bdc0-5fdb-4f5f-a581-af997887a6fe tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:23.532269 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f9c6bdc0-5fdb-4f5f-a581-af997887a6fe tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:24.236249 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-f9c6bdc0-5fdb-4f5f-a581-af997887a6fe tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "POST /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.721334 Sep 16 10:02:24.236871 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 566/1135] 10.222.0.73 () {60 vars in 1323 bytes} [Fri Sep 16 10:02:23 2022] POST /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697/os-volume_attachments => generated 194 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 10:02:31.780173 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-b49bfad2-ca00-4c58-80ea-7fd717c67410 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:02:31.782362 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-b49bfad2-ca00-4c58-80ea-7fd717c67410 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 0dbcc0d7-d447-42d4-8a11-cdb458c0a697] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:02:31.788931 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b49bfad2-ca00-4c58-80ea-7fd717c67410 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:31.789409 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b49bfad2-ca00-4c58-80ea-7fd717c67410 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:31.789880 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b49bfad2-ca00-4c58-80ea-7fd717c67410 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:31.790565 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b49bfad2-ca00-4c58-80ea-7fd717c67410 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:31.791016 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b49bfad2-ca00-4c58-80ea-7fd717c67410 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:31.791436 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b49bfad2-ca00-4c58-80ea-7fd717c67410 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:31.820411 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-b49bfad2-ca00-4c58-80ea-7fd717c67410 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044111 Sep 16 10:02:31.820950 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 570/1136] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Sep 16 10:02:31 2022] GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 10:02:31.832793 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-dd0ec7de-9bf4-46a2-9e0e-bc356bafa808 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:02:31.833375 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-dd0ec7de-9bf4-46a2-9e0e-bc356bafa808 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 0dbcc0d7-d447-42d4-8a11-cdb458c0a697] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:02:31.840381 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dd0ec7de-9bf4-46a2-9e0e-bc356bafa808 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:31.840865 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dd0ec7de-9bf4-46a2-9e0e-bc356bafa808 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:31.841303 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dd0ec7de-9bf4-46a2-9e0e-bc356bafa808 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:31.842046 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dd0ec7de-9bf4-46a2-9e0e-bc356bafa808 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:31.842512 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dd0ec7de-9bf4-46a2-9e0e-bc356bafa808 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:31.842934 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-dd0ec7de-9bf4-46a2-9e0e-bc356bafa808 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:31.871824 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-dd0ec7de-9bf4-46a2-9e0e-bc356bafa808 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697/os-volume_attachments/14f6ef3c-c897-44b5-a727-de340aa88ac2" status: 200 len: 194 microversion: 2.1 time: 0.043269 Sep 16 10:02:31.872404 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 567/1137] 10.222.0.73 () {58 vars in 1413 bytes} [Fri Sep 16 10:02:31 2022] GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697/os-volume_attachments/14f6ef3c-c897-44b5-a727-de340aa88ac2 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 10:02:33.530881 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-57ef1d67-28b1-4642-a6cb-2319b0c66b2d tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f7813523-d912-4853-999b-523b510f7f4f"}} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 10:02:33.533215 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-57ef1d67-28b1-4642-a6cb-2319b0c66b2d tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 0dbcc0d7-d447-42d4-8a11-cdb458c0a697] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:02:33.539728 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-57ef1d67-28b1-4642-a6cb-2319b0c66b2d tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:33.541183 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-57ef1d67-28b1-4642-a6cb-2319b0c66b2d tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:33.541749 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-57ef1d67-28b1-4642-a6cb-2319b0c66b2d tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:33.542460 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-57ef1d67-28b1-4642-a6cb-2319b0c66b2d tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:33.542933 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-57ef1d67-28b1-4642-a6cb-2319b0c66b2d tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:33.543394 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-57ef1d67-28b1-4642-a6cb-2319b0c66b2d tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:34.257245 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-57ef1d67-28b1-4642-a6cb-2319b0c66b2d tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "POST /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.730139 Sep 16 10:02:34.257916 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 571/1138] 10.222.0.73 () {60 vars in 1323 bytes} [Fri Sep 16 10:02:33 2022] POST /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697/os-volume_attachments => generated 194 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 10:02:41.786519 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-8f874759-21b2-4794-b0d1-3da532ea3a77 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:02:41.788779 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-8f874759-21b2-4794-b0d1-3da532ea3a77 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 0dbcc0d7-d447-42d4-8a11-cdb458c0a697] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:02:41.796098 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8f874759-21b2-4794-b0d1-3da532ea3a77 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:41.799532 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8f874759-21b2-4794-b0d1-3da532ea3a77 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:41.799532 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8f874759-21b2-4794-b0d1-3da532ea3a77 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:41.799532 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8f874759-21b2-4794-b0d1-3da532ea3a77 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:41.799532 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8f874759-21b2-4794-b0d1-3da532ea3a77 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:41.799920 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-8f874759-21b2-4794-b0d1-3da532ea3a77 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:41.833438 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-8f874759-21b2-4794-b0d1-3da532ea3a77 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050771 Sep 16 10:02:41.834062 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 568/1139] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Sep 16 10:02:41 2022] GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 10:02:41.983805 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-a17e2971-a907-49c0-bb4f-1a480f6f9b7b tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:02:41.984354 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-a17e2971-a907-49c0-bb4f-1a480f6f9b7b tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 0dbcc0d7-d447-42d4-8a11-cdb458c0a697] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:02:41.990631 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a17e2971-a907-49c0-bb4f-1a480f6f9b7b tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:41.991123 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a17e2971-a907-49c0-bb4f-1a480f6f9b7b tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:41.991567 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a17e2971-a907-49c0-bb4f-1a480f6f9b7b tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:41.992304 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a17e2971-a907-49c0-bb4f-1a480f6f9b7b tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:41.992763 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a17e2971-a907-49c0-bb4f-1a480f6f9b7b tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:41.993197 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a17e2971-a907-49c0-bb4f-1a480f6f9b7b tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:42.023162 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-a17e2971-a907-49c0-bb4f-1a480f6f9b7b tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697/os-volume_attachments/14f6ef3c-c897-44b5-a727-de340aa88ac2" status: 200 len: 194 microversion: 2.1 time: 0.045240 Sep 16 10:02:42.023738 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 572/1140] 10.222.0.73 () {58 vars in 1413 bytes} [Fri Sep 16 10:02:41 2022] GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697/os-volume_attachments/14f6ef3c-c897-44b5-a727-de340aa88ac2 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 10:02:42.034561 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-844ffda9-a20e-495e-aeb6-214b58a2beeb tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:02:42.035087 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-844ffda9-a20e-495e-aeb6-214b58a2beeb tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 0dbcc0d7-d447-42d4-8a11-cdb458c0a697] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:02:42.040892 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-844ffda9-a20e-495e-aeb6-214b58a2beeb tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:42.041375 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-844ffda9-a20e-495e-aeb6-214b58a2beeb tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:42.041861 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-844ffda9-a20e-495e-aeb6-214b58a2beeb tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:42.042546 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-844ffda9-a20e-495e-aeb6-214b58a2beeb tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:42.043001 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-844ffda9-a20e-495e-aeb6-214b58a2beeb tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:42.043426 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-844ffda9-a20e-495e-aeb6-214b58a2beeb tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:42.122096 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.objects.instance [None req-844ffda9-a20e-495e-aeb6-214b58a2beeb tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lazy-loading 'services' on Instance uuid 0dbcc0d7-d447-42d4-8a11-cdb458c0a697 {{(pid=127670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 10:02:42.323576 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-844ffda9-a20e-495e-aeb6-214b58a2beeb tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "DELETE /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697/os-volume_attachments/14f6ef3c-c897-44b5-a727-de340aa88ac2" status: 202 len: 0 microversion: 2.1 time: 0.292725 Sep 16 10:02:42.324218 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 569/1141] 10.222.0.73 () {58 vars in 1416 bytes} [Fri Sep 16 10:02:42 2022] DELETE /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697/os-volume_attachments/14f6ef3c-c897-44b5-a727-de340aa88ac2 => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 10:02:44.505079 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-1a80a8c4-c82c-441a-86bf-ae78e8e7d462 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:02:44.505588 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-1a80a8c4-c82c-441a-86bf-ae78e8e7d462 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 0dbcc0d7-d447-42d4-8a11-cdb458c0a697] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:02:44.512049 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1a80a8c4-c82c-441a-86bf-ae78e8e7d462 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:44.512539 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1a80a8c4-c82c-441a-86bf-ae78e8e7d462 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:44.512980 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1a80a8c4-c82c-441a-86bf-ae78e8e7d462 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:44.514205 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1a80a8c4-c82c-441a-86bf-ae78e8e7d462 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:44.514808 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1a80a8c4-c82c-441a-86bf-ae78e8e7d462 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:44.515238 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1a80a8c4-c82c-441a-86bf-ae78e8e7d462 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:44.544195 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-1a80a8c4-c82c-441a-86bf-ae78e8e7d462 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697/os-volume_attachments/f7813523-d912-4853-999b-523b510f7f4f" status: 200 len: 194 microversion: 2.1 time: 0.043096 Sep 16 10:02:44.544783 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 573/1142] 10.222.0.73 () {58 vars in 1413 bytes} [Fri Sep 16 10:02:44 2022] GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697/os-volume_attachments/f7813523-d912-4853-999b-523b510f7f4f => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 10:02:44.556438 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-233d3ba2-2f56-49a4-8d43-6fb8b7c137d2 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:02:44.557021 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-233d3ba2-2f56-49a4-8d43-6fb8b7c137d2 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 0dbcc0d7-d447-42d4-8a11-cdb458c0a697] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:02:44.563332 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-233d3ba2-2f56-49a4-8d43-6fb8b7c137d2 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:44.563815 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-233d3ba2-2f56-49a4-8d43-6fb8b7c137d2 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:44.564251 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-233d3ba2-2f56-49a4-8d43-6fb8b7c137d2 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:44.564937 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-233d3ba2-2f56-49a4-8d43-6fb8b7c137d2 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:44.565440 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-233d3ba2-2f56-49a4-8d43-6fb8b7c137d2 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:44.565853 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-233d3ba2-2f56-49a4-8d43-6fb8b7c137d2 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:44.646001 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.objects.instance [None req-233d3ba2-2f56-49a4-8d43-6fb8b7c137d2 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lazy-loading 'services' on Instance uuid 0dbcc0d7-d447-42d4-8a11-cdb458c0a697 {{(pid=127670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 10:02:44.832379 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-233d3ba2-2f56-49a4-8d43-6fb8b7c137d2 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "DELETE /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697/os-volume_attachments/f7813523-d912-4853-999b-523b510f7f4f" status: 202 len: 0 microversion: 2.1 time: 0.280478 Sep 16 10:02:44.832960 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 570/1143] 10.222.0.73 () {58 vars in 1416 bytes} [Fri Sep 16 10:02:44 2022] DELETE /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697/os-volume_attachments/f7813523-d912-4853-999b-523b510f7f4f => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 10:02:46.006254 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-499e1aa4-9e17-4f0d-bf78-e8ffd549dd2e tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:02:46.008534 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-499e1aa4-9e17-4f0d-bf78-e8ffd549dd2e tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 0dbcc0d7-d447-42d4-8a11-cdb458c0a697] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:02:46.015697 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-499e1aa4-9e17-4f0d-bf78-e8ffd549dd2e tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:46.016394 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-499e1aa4-9e17-4f0d-bf78-e8ffd549dd2e tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:46.016845 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-499e1aa4-9e17-4f0d-bf78-e8ffd549dd2e tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:46.017576 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-499e1aa4-9e17-4f0d-bf78-e8ffd549dd2e tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:46.018091 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-499e1aa4-9e17-4f0d-bf78-e8ffd549dd2e tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:46.018511 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-499e1aa4-9e17-4f0d-bf78-e8ffd549dd2e tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:46.047821 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-499e1aa4-9e17-4f0d-bf78-e8ffd549dd2e tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045514 Sep 16 10:02:46.048371 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 574/1144] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Sep 16 10:02:46 2022] GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 10:02:46.163490 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-e4c45bec-d9bc-47f4-a8bc-be219a27943c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:02:46.165898 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-e4c45bec-d9bc-47f4-a8bc-be219a27943c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 0dbcc0d7-d447-42d4-8a11-cdb458c0a697] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:02:46.172989 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e4c45bec-d9bc-47f4-a8bc-be219a27943c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:46.173476 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e4c45bec-d9bc-47f4-a8bc-be219a27943c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:46.173949 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e4c45bec-d9bc-47f4-a8bc-be219a27943c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:46.174649 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e4c45bec-d9bc-47f4-a8bc-be219a27943c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:46.175117 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e4c45bec-d9bc-47f4-a8bc-be219a27943c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:46.175551 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e4c45bec-d9bc-47f4-a8bc-be219a27943c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:46.204364 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-e4c45bec-d9bc-47f4-a8bc-be219a27943c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045756 Sep 16 10:02:46.204913 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 571/1145] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Sep 16 10:02:46 2022] GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 10:02:46.266935 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-fa7751c9-27e4-4e75-9f36-17049cb6f39f tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:02:46.267432 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-fa7751c9-27e4-4e75-9f36-17049cb6f39f tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 0dbcc0d7-d447-42d4-8a11-cdb458c0a697] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:02:46.273262 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-fa7751c9-27e4-4e75-9f36-17049cb6f39f tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:46.273781 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-fa7751c9-27e4-4e75-9f36-17049cb6f39f tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:46.274220 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-fa7751c9-27e4-4e75-9f36-17049cb6f39f tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:46.274904 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-fa7751c9-27e4-4e75-9f36-17049cb6f39f tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:46.275356 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-fa7751c9-27e4-4e75-9f36-17049cb6f39f tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:46.275778 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-fa7751c9-27e4-4e75-9f36-17049cb6f39f tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:46.300336 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-fa7751c9-27e4-4e75-9f36-17049cb6f39f tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 0dbcc0d7-d447-42d4-8a11-cdb458c0a697] Going to try to terminate instance {{(pid=127671) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 10:02:46.641877 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-fa7751c9-27e4-4e75-9f36-17049cb6f39f tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "DELETE /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697" status: 204 len: 0 microversion: 2.1 time: 0.378464 Sep 16 10:02:46.642463 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 575/1146] 10.222.0.73 () {58 vars in 1239 bytes} [Fri Sep 16 10:02:46 2022] DELETE /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 10:02:46.650664 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-9a5a4a5f-c22a-4d95-a3cc-37b781dd444f tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:02:46.654261 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-9a5a4a5f-c22a-4d95-a3cc-37b781dd444f tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 0dbcc0d7-d447-42d4-8a11-cdb458c0a697] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:02:46.658106 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9a5a4a5f-c22a-4d95-a3cc-37b781dd444f tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:46.658589 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9a5a4a5f-c22a-4d95-a3cc-37b781dd444f tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:46.659026 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9a5a4a5f-c22a-4d95-a3cc-37b781dd444f tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:46.659748 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9a5a4a5f-c22a-4d95-a3cc-37b781dd444f tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:46.660206 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9a5a4a5f-c22a-4d95-a3cc-37b781dd444f tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:46.660629 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-9a5a4a5f-c22a-4d95-a3cc-37b781dd444f tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:46.804222 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-9a5a4a5f-c22a-4d95-a3cc-37b781dd444f tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:02:46.811912 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-9a5a4a5f-c22a-4d95-a3cc-37b781dd444f tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697" status: 200 len: 1674 microversion: 2.1 time: 0.165092 Sep 16 10:02:46.812467 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 572/1147] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:02:46 2022] GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697 => generated 1674 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:02:47.836673 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-552160b6-233e-452f-ab2b-2ed18823b39c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:02:47.837382 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-552160b6-233e-452f-ab2b-2ed18823b39c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 0dbcc0d7-d447-42d4-8a11-cdb458c0a697] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:02:47.844044 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-552160b6-233e-452f-ab2b-2ed18823b39c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:47.844586 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-552160b6-233e-452f-ab2b-2ed18823b39c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:47.845033 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-552160b6-233e-452f-ab2b-2ed18823b39c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:47.845767 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-552160b6-233e-452f-ab2b-2ed18823b39c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:47.846234 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-552160b6-233e-452f-ab2b-2ed18823b39c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:47.846671 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-552160b6-233e-452f-ab2b-2ed18823b39c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:47.977262 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-552160b6-233e-452f-ab2b-2ed18823b39c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:02:47.985596 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-552160b6-233e-452f-ab2b-2ed18823b39c tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697" status: 200 len: 1674 microversion: 2.1 time: 0.152687 Sep 16 10:02:47.986170 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 576/1148] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:02:47 2022] GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:02:49.008490 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-99f513e6-5a07-478e-a5a2-e3338a7e64ef tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:02:49.009232 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-99f513e6-5a07-478e-a5a2-e3338a7e64ef tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 0dbcc0d7-d447-42d4-8a11-cdb458c0a697] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:02:49.015853 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-99f513e6-5a07-478e-a5a2-e3338a7e64ef tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:49.017399 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-99f513e6-5a07-478e-a5a2-e3338a7e64ef tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:49.017783 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-99f513e6-5a07-478e-a5a2-e3338a7e64ef tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:49.018558 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-99f513e6-5a07-478e-a5a2-e3338a7e64ef tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:49.019099 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-99f513e6-5a07-478e-a5a2-e3338a7e64ef tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:49.019604 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-99f513e6-5a07-478e-a5a2-e3338a7e64ef tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:49.085504 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-99f513e6-5a07-478e-a5a2-e3338a7e64ef tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:02:49.093382 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-99f513e6-5a07-478e-a5a2-e3338a7e64ef tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697" status: 200 len: 1606 microversion: 2.1 time: 0.088750 Sep 16 10:02:49.094242 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 573/1149] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:02:49 2022] GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697 => generated 1606 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:02:49.243261 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [req-bd5fd0c6-f364-4ed0-b580-5d4960f8e4cd req-377497e1-ca4a-428a-839e-319263129b18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dbcc0d7-d447-42d4-8a11-cdb458c0a697", "name": "network-vif-deleted", "tag": "97cdb95d-619a-43b7-bb59-0593c39fa45d"}]} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 10:02:49.249831 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-bd5fd0c6-f364-4ed0-b580-5d4960f8e4cd req-377497e1-ca4a-428a-839e-319263129b18 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:49.250317 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-bd5fd0c6-f364-4ed0-b580-5d4960f8e4cd req-377497e1-ca4a-428a-839e-319263129b18 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:49.251072 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-bd5fd0c6-f364-4ed0-b580-5d4960f8e4cd req-377497e1-ca4a-428a-839e-319263129b18 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:49.263316 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.compute.server_external_events [req-bd5fd0c6-f364-4ed0-b580-5d4960f8e4cd req-377497e1-ca4a-428a-839e-319263129b18 service nova] Creating event network-vif-deleted:97cdb95d-619a-43b7-bb59-0593c39fa45d for instance 0dbcc0d7-d447-42d4-8a11-cdb458c0a697 on hv-cinder-79053 Sep 16 10:02:49.268541 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [req-bd5fd0c6-f364-4ed0-b580-5d4960f8e4cd req-377497e1-ca4a-428a-839e-319263129b18 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032213 Sep 16 10:02:49.269856 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 577/1150] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 10:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 10:02:50.116698 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-a8094da6-6daf-40c9-bc90-953734e2a680 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:02:50.117682 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-a8094da6-6daf-40c9-bc90-953734e2a680 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 0dbcc0d7-d447-42d4-8a11-cdb458c0a697] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:02:50.124401 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a8094da6-6daf-40c9-bc90-953734e2a680 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:50.124998 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a8094da6-6daf-40c9-bc90-953734e2a680 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:50.125570 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a8094da6-6daf-40c9-bc90-953734e2a680 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:50.126446 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a8094da6-6daf-40c9-bc90-953734e2a680 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:50.126955 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a8094da6-6daf-40c9-bc90-953734e2a680 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:50.127615 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a8094da6-6daf-40c9-bc90-953734e2a680 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:50.161678 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a8094da6-6daf-40c9-bc90-953734e2a680 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:50.162185 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a8094da6-6daf-40c9-bc90-953734e2a680 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:50.162628 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a8094da6-6daf-40c9-bc90-953734e2a680 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:50.163086 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.objects.instance [None req-a8094da6-6daf-40c9-bc90-953734e2a680 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lazy-loading 'fault' on Instance uuid 0dbcc0d7-d447-42d4-8a11-cdb458c0a697 {{(pid=127670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 10:02:50.204536 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-a8094da6-6daf-40c9-bc90-953734e2a680 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ffd25afbc1b42c995ff96c21221b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e9f7169b754d5daa040eb465e858e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:02:50.214303 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-a8094da6-6daf-40c9-bc90-953734e2a680 tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697" status: 200 len: 1328 microversion: 2.1 time: 0.101573 Sep 16 10:02:50.214890 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 574/1151] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:02:50 2022] GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697 => generated 1328 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:02:51.239037 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-4e449038-ac3d-4db3-beff-559385f2f7ae tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:02:51.239742 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-4e449038-ac3d-4db3-beff-559385f2f7ae tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 0dbcc0d7-d447-42d4-8a11-cdb458c0a697] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:02:51.245905 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4e449038-ac3d-4db3-beff-559385f2f7ae tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:51.246382 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4e449038-ac3d-4db3-beff-559385f2f7ae tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:51.246814 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4e449038-ac3d-4db3-beff-559385f2f7ae tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:51.247496 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4e449038-ac3d-4db3-beff-559385f2f7ae tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:51.247944 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4e449038-ac3d-4db3-beff-559385f2f7ae tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:51.248365 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-4e449038-ac3d-4db3-beff-559385f2f7ae tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:51.262902 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.wsgi [None req-4e449038-ac3d-4db3-beff-559385f2f7ae tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] HTTP exception thrown: Instance 0dbcc0d7-d447-42d4-8a11-cdb458c0a697 could not be found. Sep 16 10:02:51.264503 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-4e449038-ac3d-4db3-beff-559385f2f7ae tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Request method failure captured: Sep 16 10:02:51.264503 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: request: GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697 HTTP/1.1 Sep 16 10:02:51.264503 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept: application/json Sep 16 10:02:51.264503 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept-Encoding: identity Sep 16 10:02:51.264503 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Connection: close Sep 16 10:02:51.264503 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Length: 0 Sep 16 10:02:51.264503 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Type: application/json Sep 16 10:02:51.264503 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Host: 10.222.0.73 Sep 16 10:02:51.264503 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Openstack-System-Scope: None Sep 16 10:02:51.264503 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: User-Agent: python-urllib3/1.26.12 Sep 16 10:02:51.264503 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Auth-Token: gAAAAABjJEjLUGfdurvibi0jSt__YF9bN28jjCj46J60KV1MWIbJuT9jV5dbfoguM_hJYDM0C3iVf6V-SEjW3Du4uITfzqCdj3Iiqq4oHbvWrNlWPcHNQZ9r9kW8dpT5uOK4ec2G1gFeu1jjY6MZ0TiA-PlAvs_F4DB2Nb_sHFUo7HfyZvdonQQ Sep 16 10:02:51.264503 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Id: None Sep 16 10:02:51.264503 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Name: None Sep 16 10:02:51.264503 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Identity-Status: Confirmed Sep 16 10:02:51.264503 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Is-Admin-Project: True Sep 16 10:02:51.264503 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Id: default Sep 16 10:02:51.264503 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Name: Default Sep 16 10:02:51.264503 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Id: 75e9f7169b754d5daa040eb465e858e5 Sep 16 10:02:51.264503 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Name: tempest-AttachVolumeTestJSON-104526531 Sep 16 10:02:51.264503 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Role: reader,member Sep 16 10:02:51.264503 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Roles: reader,member Sep 16 10:02:51.266202 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/75e9f7169b754d5daa040eb465e858e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_75e9f7169b754d5daa040eb465e858e5", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/75e9f7169b754d5daa040eb465e858e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/75e9f7169b754d5daa040eb465e858e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 10:02:51.266202 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant: tempest-AttachVolumeTestJSON-104526531 Sep 16 10:02:51.266202 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Id: 75e9f7169b754d5daa040eb465e858e5 Sep 16 10:02:51.266202 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Name: tempest-AttachVolumeTestJSON-104526531 Sep 16 10:02:51.266202 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User: tempest-AttachVolumeTestJSON-104526531-project Sep 16 10:02:51.266202 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Id: default Sep 16 10:02:51.266202 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Name: Default Sep 16 10:02:51.266202 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Id: 6ffd25afbc1b42c995ff96c21221b310 Sep 16 10:02:51.266202 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Name: tempest-AttachVolumeTestJSON-104526531-project Sep 16 10:02:51.266202 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: method: > Sep 16 10:02:51.266202 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: exception: Instance 0dbcc0d7-d447-42d4-8a11-cdb458c0a697 could not be found. Sep 16 10:02:51.266202 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: action_args: {'id': '0dbcc0d7-d447-42d4-8a11-cdb458c0a697'} Sep 16 10:02:51.270223 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 10:02:51.270223 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 10:02:51.270223 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 10:02:51.270223 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 10:02:51.270223 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 10:02:51.270223 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 10:02:51.270223 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 10:02:51.270223 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 10:02:51.270223 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 10:02:51.270223 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 10:02:51.270223 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dbcc0d7-d447-42d4-8a11-cdb458c0a697 could not be found. Sep 16 10:02:51.270223 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 10:02:51.270223 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 10:02:51.270223 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 10:02:51.270223 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 10:02:51.270223 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 10:02:51.270223 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 10:02:51.270223 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 10:02:51.270223 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 10:02:51.270223 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 10:02:51.271563 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 10:02:51.271563 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 10:02:51.271563 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 10:02:51.271563 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 10:02:51.271563 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 10:02:51.271563 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 10:02:51.271563 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 10:02:51.271563 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dbcc0d7-d447-42d4-8a11-cdb458c0a697 could not be found. Sep 16 10:02:51.271563 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 10:02:51.271563 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 10:02:51.271563 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 10:02:51.271563 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 10:02:51.271563 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 10:02:51.271563 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 10:02:51.271563 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 10:02:51.271563 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 10:02:51.271563 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dbcc0d7-d447-42d4-8a11-cdb458c0a697 could not be found. Sep 16 10:02:51.271563 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 10:02:51.272745 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-4e449038-ac3d-4db3-beff-559385f2f7ae tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Returning 404 to user: Instance 0dbcc0d7-d447-42d4-8a11-cdb458c0a697 could not be found. {{(pid=127671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 10:02:51.272745 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-4e449038-ac3d-4db3-beff-559385f2f7ae tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697" status: 404 len: 111 microversion: 2.1 time: 0.032444 Sep 16 10:02:51.272745 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 578/1152] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:02:51 2022] GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 10:02:51.274694 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-e3d49e65-6c12-4ed9-a927-12733998bb7e tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '.version_select at 0x7ffa6dd04700>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:02:51.351027 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-e3d49e65-6c12-4ed9-a927-12733998bb7e tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1750700227" status: 202 len: 0 microversion: 2.1 time: 0.080055 Sep 16 10:02:51.351605 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 575/1153] 10.222.0.73 () {58 vars in 1221 bytes} [Fri Sep 16 10:02:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1750700227 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 10:02:54.466350 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-e7446386-c9fd-4d19-b0ac-7bd3f8f51ef8 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:02:54.466854 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-e7446386-c9fd-4d19-b0ac-7bd3f8f51ef8 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:02:54.471404 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-d5241cf2-c338-4550-8699-9f02ec02987d req-9b68625c-89d3-4448-a909-4a60367269bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70372e0b-76cc-4156-84ae-3734dd9f7b25", "tag": "cc7b6bd5-7e7c-4cc5-8097-75cfcd4c3ad8"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 10:02:54.475689 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e7446386-c9fd-4d19-b0ac-7bd3f8f51ef8 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:54.476187 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e7446386-c9fd-4d19-b0ac-7bd3f8f51ef8 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:54.476629 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e7446386-c9fd-4d19-b0ac-7bd3f8f51ef8 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:54.477331 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e7446386-c9fd-4d19-b0ac-7bd3f8f51ef8 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:54.477971 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e7446386-c9fd-4d19-b0ac-7bd3f8f51ef8 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:54.478550 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e7446386-c9fd-4d19-b0ac-7bd3f8f51ef8 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:54.478696 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 10:02:54.483472 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-d5241cf2-c338-4550-8699-9f02ec02987d req-9b68625c-89d3-4448-a909-4a60367269bf service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:54.483951 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-d5241cf2-c338-4550-8699-9f02ec02987d req-9b68625c-89d3-4448-a909-4a60367269bf service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:54.484400 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-d5241cf2-c338-4550-8699-9f02ec02987d req-9b68625c-89d3-4448-a909-4a60367269bf service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:54.496176 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 10:02:54.498257 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-d5241cf2-c338-4550-8699-9f02ec02987d req-9b68625c-89d3-4448-a909-4a60367269bf service nova] Creating event network-changed:cc7b6bd5-7e7c-4cc5-8097-75cfcd4c3ad8 for instance 70372e0b-76cc-4156-84ae-3734dd9f7b25 on hv-cinder-79053 Sep 16 10:02:54.503939 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-d5241cf2-c338-4550-8699-9f02ec02987d req-9b68625c-89d3-4448-a909-4a60367269bf service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036787 Sep 16 10:02:54.504884 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 576/1154] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 10:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 10:02:54.505806 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-e7446386-c9fd-4d19-b0ac-7bd3f8f51ef8 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] Going to try to terminate instance {{(pid=127671) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 10:02:54.670345 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-498e735c-a2a1-4122-a442-b70dd12adb2a tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:02:54.671633 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-498e735c-a2a1-4122-a442-b70dd12adb2a tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 0dbcc0d7-d447-42d4-8a11-cdb458c0a697] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:02:54.680458 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-498e735c-a2a1-4122-a442-b70dd12adb2a tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:54.680960 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-498e735c-a2a1-4122-a442-b70dd12adb2a tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:54.681504 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-498e735c-a2a1-4122-a442-b70dd12adb2a tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:54.682254 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-498e735c-a2a1-4122-a442-b70dd12adb2a tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:54.682723 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-498e735c-a2a1-4122-a442-b70dd12adb2a tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:54.683210 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-498e735c-a2a1-4122-a442-b70dd12adb2a tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:54.698659 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.wsgi [None req-498e735c-a2a1-4122-a442-b70dd12adb2a tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] HTTP exception thrown: Instance 0dbcc0d7-d447-42d4-8a11-cdb458c0a697 could not be found. Sep 16 10:02:54.700468 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-498e735c-a2a1-4122-a442-b70dd12adb2a tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Request method failure captured: Sep 16 10:02:54.700468 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: request: DELETE /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697 HTTP/1.1 Sep 16 10:02:54.700468 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept: application/json Sep 16 10:02:54.700468 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Sep 16 10:02:54.700468 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Connection: close Sep 16 10:02:54.700468 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Length: 0 Sep 16 10:02:54.700468 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Type: application/json Sep 16 10:02:54.700468 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Host: 10.222.0.73 Sep 16 10:02:54.700468 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Sep 16 10:02:54.700468 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Sep 16 10:02:54.700468 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjJEjLUGfdurvibi0jSt__YF9bN28jjCj46J60KV1MWIbJuT9jV5dbfoguM_hJYDM0C3iVf6V-SEjW3Du4uITfzqCdj3Iiqq4oHbvWrNlWPcHNQZ9r9kW8dpT5uOK4ec2G1gFeu1jjY6MZ0TiA-PlAvs_F4DB2Nb_sHFUo7HfyZvdonQQ Sep 16 10:02:54.700468 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Sep 16 10:02:54.700468 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Sep 16 10:02:54.700468 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Sep 16 10:02:54.700468 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Sep 16 10:02:54.700468 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Sep 16 10:02:54.700468 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Sep 16 10:02:54.700468 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Id: 75e9f7169b754d5daa040eb465e858e5 Sep 16 10:02:54.700468 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-AttachVolumeTestJSON-104526531 Sep 16 10:02:54.700468 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Role: reader,member Sep 16 10:02:54.700468 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Roles: reader,member Sep 16 10:02:54.705015 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/75e9f7169b754d5daa040eb465e858e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_75e9f7169b754d5daa040eb465e858e5", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/75e9f7169b754d5daa040eb465e858e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/75e9f7169b754d5daa040eb465e858e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 10:02:54.705015 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-AttachVolumeTestJSON-104526531 Sep 16 10:02:54.705015 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Id: 75e9f7169b754d5daa040eb465e858e5 Sep 16 10:02:54.705015 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-AttachVolumeTestJSON-104526531 Sep 16 10:02:54.705015 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User: tempest-AttachVolumeTestJSON-104526531-project Sep 16 10:02:54.705015 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Sep 16 10:02:54.705015 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Sep 16 10:02:54.705015 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Id: 6ffd25afbc1b42c995ff96c21221b310 Sep 16 10:02:54.705015 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-AttachVolumeTestJSON-104526531-project Sep 16 10:02:54.705015 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: method: > Sep 16 10:02:54.705015 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: exception: Instance 0dbcc0d7-d447-42d4-8a11-cdb458c0a697 could not be found. Sep 16 10:02:54.705015 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: action_args: {'id': '0dbcc0d7-d447-42d4-8a11-cdb458c0a697'} Sep 16 10:02:54.705845 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 10:02:54.705845 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 10:02:54.705845 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 10:02:54.705845 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 10:02:54.705845 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 10:02:54.705845 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 10:02:54.705845 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 10:02:54.705845 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 10:02:54.705845 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 10:02:54.705845 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 10:02:54.705845 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dbcc0d7-d447-42d4-8a11-cdb458c0a697 could not be found. Sep 16 10:02:54.705845 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 10:02:54.705845 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 10:02:54.705845 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 10:02:54.705845 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 10:02:54.705845 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 10:02:54.705845 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 10:02:54.705845 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 10:02:54.705845 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 10:02:54.705845 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 10:02:54.707387 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 10:02:54.707387 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 10:02:54.707387 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 10:02:54.707387 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 10:02:54.707387 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 10:02:54.707387 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 10:02:54.707387 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 10:02:54.707387 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 10:02:54.707387 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 10:02:54.707387 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dbcc0d7-d447-42d4-8a11-cdb458c0a697 could not be found. Sep 16 10:02:54.707387 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 10:02:54.707387 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 10:02:54.707387 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 10:02:54.707387 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 10:02:54.707387 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 10:02:54.707387 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 10:02:54.707387 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 10:02:54.707387 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 10:02:54.707387 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dbcc0d7-d447-42d4-8a11-cdb458c0a697 could not be found. Sep 16 10:02:54.707387 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 10:02:54.708889 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-498e735c-a2a1-4122-a442-b70dd12adb2a tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Returning 404 to user: Instance 0dbcc0d7-d447-42d4-8a11-cdb458c0a697 could not be found. {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 10:02:54.708889 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-498e735c-a2a1-4122-a442-b70dd12adb2a tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "DELETE /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697" status: 404 len: 111 microversion: 2.1 time: 0.037105 Sep 16 10:02:54.708889 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 577/1155] 10.222.0.73 () {58 vars in 1239 bytes} [Fri Sep 16 10:02:54 2022] DELETE /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 10:02:54.712562 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-f35f86b8-de54-4b0d-a20a-3f060877ea8e tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:02:54.713282 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-f35f86b8-de54-4b0d-a20a-3f060877ea8e tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 0dbcc0d7-d447-42d4-8a11-cdb458c0a697] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:02:54.720750 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f35f86b8-de54-4b0d-a20a-3f060877ea8e tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:54.721345 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f35f86b8-de54-4b0d-a20a-3f060877ea8e tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:54.722070 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f35f86b8-de54-4b0d-a20a-3f060877ea8e tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:54.722853 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f35f86b8-de54-4b0d-a20a-3f060877ea8e tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:54.723410 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f35f86b8-de54-4b0d-a20a-3f060877ea8e tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:54.724166 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f35f86b8-de54-4b0d-a20a-3f060877ea8e tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:54.739542 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.wsgi [None req-f35f86b8-de54-4b0d-a20a-3f060877ea8e tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] HTTP exception thrown: Instance 0dbcc0d7-d447-42d4-8a11-cdb458c0a697 could not be found. Sep 16 10:02:54.742972 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-f35f86b8-de54-4b0d-a20a-3f060877ea8e tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Request method failure captured: Sep 16 10:02:54.742972 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: request: GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697 HTTP/1.1 Sep 16 10:02:54.742972 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept: application/json Sep 16 10:02:54.742972 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Sep 16 10:02:54.742972 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Connection: close Sep 16 10:02:54.742972 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Length: 0 Sep 16 10:02:54.742972 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Type: application/json Sep 16 10:02:54.742972 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Host: 10.222.0.73 Sep 16 10:02:54.742972 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Sep 16 10:02:54.742972 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Sep 16 10:02:54.742972 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjJEjLUGfdurvibi0jSt__YF9bN28jjCj46J60KV1MWIbJuT9jV5dbfoguM_hJYDM0C3iVf6V-SEjW3Du4uITfzqCdj3Iiqq4oHbvWrNlWPcHNQZ9r9kW8dpT5uOK4ec2G1gFeu1jjY6MZ0TiA-PlAvs_F4DB2Nb_sHFUo7HfyZvdonQQ Sep 16 10:02:54.742972 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Sep 16 10:02:54.742972 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Sep 16 10:02:54.742972 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Sep 16 10:02:54.742972 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Sep 16 10:02:54.742972 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Sep 16 10:02:54.742972 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Sep 16 10:02:54.742972 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Id: 75e9f7169b754d5daa040eb465e858e5 Sep 16 10:02:54.742972 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-AttachVolumeTestJSON-104526531 Sep 16 10:02:54.742972 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Role: reader,member Sep 16 10:02:54.742972 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Roles: reader,member Sep 16 10:02:54.744427 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/75e9f7169b754d5daa040eb465e858e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_75e9f7169b754d5daa040eb465e858e5", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/75e9f7169b754d5daa040eb465e858e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/75e9f7169b754d5daa040eb465e858e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 10:02:54.744427 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-AttachVolumeTestJSON-104526531 Sep 16 10:02:54.744427 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Id: 75e9f7169b754d5daa040eb465e858e5 Sep 16 10:02:54.744427 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-AttachVolumeTestJSON-104526531 Sep 16 10:02:54.744427 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User: tempest-AttachVolumeTestJSON-104526531-project Sep 16 10:02:54.744427 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Sep 16 10:02:54.744427 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Sep 16 10:02:54.744427 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Id: 6ffd25afbc1b42c995ff96c21221b310 Sep 16 10:02:54.744427 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-AttachVolumeTestJSON-104526531-project Sep 16 10:02:54.744427 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: method: > Sep 16 10:02:54.744427 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: exception: Instance 0dbcc0d7-d447-42d4-8a11-cdb458c0a697 could not be found. Sep 16 10:02:54.744427 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: action_args: {'id': '0dbcc0d7-d447-42d4-8a11-cdb458c0a697'} Sep 16 10:02:54.745265 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 10:02:54.745265 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 10:02:54.745265 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 10:02:54.745265 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 10:02:54.745265 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 10:02:54.745265 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 10:02:54.745265 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 10:02:54.745265 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 10:02:54.745265 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 10:02:54.745265 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 10:02:54.745265 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dbcc0d7-d447-42d4-8a11-cdb458c0a697 could not be found. Sep 16 10:02:54.745265 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 10:02:54.745265 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 10:02:54.745265 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 10:02:54.745265 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 10:02:54.745265 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 10:02:54.745265 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 10:02:54.745265 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 10:02:54.745265 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 10:02:54.745265 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 10:02:54.746714 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 10:02:54.746714 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 10:02:54.746714 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 10:02:54.746714 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 10:02:54.746714 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 10:02:54.746714 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 10:02:54.746714 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 10:02:54.746714 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dbcc0d7-d447-42d4-8a11-cdb458c0a697 could not be found. Sep 16 10:02:54.746714 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 10:02:54.746714 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 10:02:54.746714 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 10:02:54.746714 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 10:02:54.746714 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 10:02:54.746714 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 10:02:54.746714 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 10:02:54.746714 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 10:02:54.746714 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dbcc0d7-d447-42d4-8a11-cdb458c0a697 could not be found. Sep 16 10:02:54.746714 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 10:02:54.748718 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-f35f86b8-de54-4b0d-a20a-3f060877ea8e tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Returning 404 to user: Instance 0dbcc0d7-d447-42d4-8a11-cdb458c0a697 could not be found. {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 10:02:54.748718 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-f35f86b8-de54-4b0d-a20a-3f060877ea8e tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697" status: 404 len: 111 microversion: 2.1 time: 0.034808 Sep 16 10:02:54.748718 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 578/1156] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:02:54 2022] GET /compute/v2.1/servers/0dbcc0d7-d447-42d4-8a11-cdb458c0a697 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 10:02:54.849702 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-e7446386-c9fd-4d19-b0ac-7bd3f8f51ef8 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "DELETE /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25" status: 204 len: 0 microversion: 2.1 time: 0.386685 Sep 16 10:02:54.850308 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 579/1157] 10.222.0.73 () {58 vars in 1239 bytes} [Fri Sep 16 10:02:54 2022] DELETE /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 10:02:54.859056 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-1dd48514-b559-4d3f-af1f-a47a4607fc3b tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:02:54.859705 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-1dd48514-b559-4d3f-af1f-a47a4607fc3b tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:02:54.867413 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1dd48514-b559-4d3f-af1f-a47a4607fc3b tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:54.867909 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1dd48514-b559-4d3f-af1f-a47a4607fc3b tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:54.868355 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1dd48514-b559-4d3f-af1f-a47a4607fc3b tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:54.869246 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1dd48514-b559-4d3f-af1f-a47a4607fc3b tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:54.869774 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1dd48514-b559-4d3f-af1f-a47a4607fc3b tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:54.870394 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1dd48514-b559-4d3f-af1f-a47a4607fc3b tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:55.040663 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-1dd48514-b559-4d3f-af1f-a47a4607fc3b tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff870e07952c4e049e17a096c477165b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e292a400454c93a48aca5510bfcee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:02:55.049317 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-1dd48514-b559-4d3f-af1f-a47a4607fc3b tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25" status: 200 len: 1569 microversion: 2.1 time: 0.194526 Sep 16 10:02:55.049985 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 579/1158] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:02:54 2022] GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25 => generated 1569 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:02:56.084770 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-ce544b79-aeca-4072-8370-cc32e66b1bdd tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:02:56.085479 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-ce544b79-aeca-4072-8370-cc32e66b1bdd tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:02:56.092061 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ce544b79-aeca-4072-8370-cc32e66b1bdd tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:56.092655 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ce544b79-aeca-4072-8370-cc32e66b1bdd tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:56.093106 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ce544b79-aeca-4072-8370-cc32e66b1bdd tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:56.094094 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ce544b79-aeca-4072-8370-cc32e66b1bdd tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:56.094558 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ce544b79-aeca-4072-8370-cc32e66b1bdd tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:56.094988 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-ce544b79-aeca-4072-8370-cc32e66b1bdd tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:56.158720 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-fa3eaf61-93b8-40b0-903a-fd01ffaf394f tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:02:56.159511 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-fa3eaf61-93b8-40b0-903a-fd01ffaf394f tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:02:56.166482 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fa3eaf61-93b8-40b0-903a-fd01ffaf394f tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:56.167053 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fa3eaf61-93b8-40b0-903a-fd01ffaf394f tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:56.167553 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fa3eaf61-93b8-40b0-903a-fd01ffaf394f tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:56.168256 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fa3eaf61-93b8-40b0-903a-fd01ffaf394f tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:56.168713 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fa3eaf61-93b8-40b0-903a-fd01ffaf394f tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:56.169137 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fa3eaf61-93b8-40b0-903a-fd01ffaf394f tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:56.183790 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.wsgi [None req-fa3eaf61-93b8-40b0-903a-fd01ffaf394f tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] HTTP exception thrown: Instance 34302fd9-9a71-41c1-8392-6b9df5f0f75e could not be found. Sep 16 10:02:56.185339 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-fa3eaf61-93b8-40b0-903a-fd01ffaf394f tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Request method failure captured: Sep 16 10:02:56.185339 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: request: DELETE /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e HTTP/1.1 Sep 16 10:02:56.185339 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept: application/json Sep 16 10:02:56.185339 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Sep 16 10:02:56.185339 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Connection: close Sep 16 10:02:56.185339 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Length: 0 Sep 16 10:02:56.185339 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Type: application/json Sep 16 10:02:56.185339 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Host: 10.222.0.73 Sep 16 10:02:56.185339 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Sep 16 10:02:56.185339 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Sep 16 10:02:56.185339 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjJEjLUGfdurvibi0jSt__YF9bN28jjCj46J60KV1MWIbJuT9jV5dbfoguM_hJYDM0C3iVf6V-SEjW3Du4uITfzqCdj3Iiqq4oHbvWrNlWPcHNQZ9r9kW8dpT5uOK4ec2G1gFeu1jjY6MZ0TiA-PlAvs_F4DB2Nb_sHFUo7HfyZvdonQQ Sep 16 10:02:56.185339 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Sep 16 10:02:56.185339 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Sep 16 10:02:56.185339 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Sep 16 10:02:56.185339 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Sep 16 10:02:56.185339 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Sep 16 10:02:56.185339 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Sep 16 10:02:56.185339 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Id: 75e9f7169b754d5daa040eb465e858e5 Sep 16 10:02:56.185339 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-AttachVolumeTestJSON-104526531 Sep 16 10:02:56.185339 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Role: reader,member Sep 16 10:02:56.185339 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Roles: reader,member Sep 16 10:02:56.187092 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/75e9f7169b754d5daa040eb465e858e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_75e9f7169b754d5daa040eb465e858e5", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/75e9f7169b754d5daa040eb465e858e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/75e9f7169b754d5daa040eb465e858e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 10:02:56.187092 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-AttachVolumeTestJSON-104526531 Sep 16 10:02:56.187092 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Id: 75e9f7169b754d5daa040eb465e858e5 Sep 16 10:02:56.187092 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-AttachVolumeTestJSON-104526531 Sep 16 10:02:56.187092 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User: tempest-AttachVolumeTestJSON-104526531-project Sep 16 10:02:56.187092 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Sep 16 10:02:56.187092 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Sep 16 10:02:56.187092 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Id: 6ffd25afbc1b42c995ff96c21221b310 Sep 16 10:02:56.187092 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-AttachVolumeTestJSON-104526531-project Sep 16 10:02:56.187092 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: method: > Sep 16 10:02:56.187092 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: exception: Instance 34302fd9-9a71-41c1-8392-6b9df5f0f75e could not be found. Sep 16 10:02:56.187092 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: action_args: {'id': '34302fd9-9a71-41c1-8392-6b9df5f0f75e'} Sep 16 10:02:56.188739 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 10:02:56.188739 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 10:02:56.188739 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 10:02:56.188739 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 10:02:56.188739 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 10:02:56.188739 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 10:02:56.188739 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 10:02:56.188739 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 10:02:56.188739 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 10:02:56.188739 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 10:02:56.188739 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34302fd9-9a71-41c1-8392-6b9df5f0f75e could not be found. Sep 16 10:02:56.188739 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 10:02:56.188739 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 10:02:56.188739 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 10:02:56.188739 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 10:02:56.188739 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 10:02:56.188739 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 10:02:56.188739 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 10:02:56.188739 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 10:02:56.188739 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 10:02:56.190823 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 10:02:56.190823 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 10:02:56.190823 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 10:02:56.190823 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 10:02:56.190823 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 10:02:56.190823 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 10:02:56.190823 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 10:02:56.190823 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 10:02:56.190823 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 10:02:56.190823 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34302fd9-9a71-41c1-8392-6b9df5f0f75e could not be found. Sep 16 10:02:56.190823 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 10:02:56.190823 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 10:02:56.190823 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 10:02:56.190823 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 10:02:56.190823 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 10:02:56.190823 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 10:02:56.190823 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 10:02:56.190823 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 10:02:56.190823 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34302fd9-9a71-41c1-8392-6b9df5f0f75e could not be found. Sep 16 10:02:56.190823 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 10:02:56.192491 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-fa3eaf61-93b8-40b0-903a-fd01ffaf394f tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Returning 404 to user: Instance 34302fd9-9a71-41c1-8392-6b9df5f0f75e could not be found. {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 10:02:56.192491 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-fa3eaf61-93b8-40b0-903a-fd01ffaf394f tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "DELETE /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e" status: 404 len: 111 microversion: 2.1 time: 0.032115 Sep 16 10:02:56.192491 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 580/1159] 10.222.0.73 () {58 vars in 1239 bytes} [Fri Sep 16 10:02:56 2022] DELETE /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 10:02:56.195691 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-b617fdc3-827a-4a1a-9cbe-5c955cfe097a tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:02:56.196304 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-b617fdc3-827a-4a1a-9cbe-5c955cfe097a tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] [instance: 34302fd9-9a71-41c1-8392-6b9df5f0f75e] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:02:56.202105 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b617fdc3-827a-4a1a-9cbe-5c955cfe097a tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:56.202592 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b617fdc3-827a-4a1a-9cbe-5c955cfe097a tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:56.203027 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b617fdc3-827a-4a1a-9cbe-5c955cfe097a tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:56.204316 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b617fdc3-827a-4a1a-9cbe-5c955cfe097a tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:56.204919 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b617fdc3-827a-4a1a-9cbe-5c955cfe097a tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:56.205163 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-b617fdc3-827a-4a1a-9cbe-5c955cfe097a tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:56.218809 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.wsgi [None req-b617fdc3-827a-4a1a-9cbe-5c955cfe097a tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] HTTP exception thrown: Instance 34302fd9-9a71-41c1-8392-6b9df5f0f75e could not be found. Sep 16 10:02:56.221458 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-b617fdc3-827a-4a1a-9cbe-5c955cfe097a tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Request method failure captured: Sep 16 10:02:56.221458 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: request: GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e HTTP/1.1 Sep 16 10:02:56.221458 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept: application/json Sep 16 10:02:56.221458 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Sep 16 10:02:56.221458 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Connection: close Sep 16 10:02:56.221458 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Length: 0 Sep 16 10:02:56.221458 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Type: application/json Sep 16 10:02:56.221458 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Host: 10.222.0.73 Sep 16 10:02:56.221458 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Sep 16 10:02:56.221458 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Sep 16 10:02:56.221458 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjJEjLUGfdurvibi0jSt__YF9bN28jjCj46J60KV1MWIbJuT9jV5dbfoguM_hJYDM0C3iVf6V-SEjW3Du4uITfzqCdj3Iiqq4oHbvWrNlWPcHNQZ9r9kW8dpT5uOK4ec2G1gFeu1jjY6MZ0TiA-PlAvs_F4DB2Nb_sHFUo7HfyZvdonQQ Sep 16 10:02:56.221458 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Sep 16 10:02:56.221458 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Sep 16 10:02:56.221458 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Sep 16 10:02:56.221458 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Sep 16 10:02:56.221458 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Sep 16 10:02:56.221458 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Sep 16 10:02:56.221458 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Id: 75e9f7169b754d5daa040eb465e858e5 Sep 16 10:02:56.221458 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-AttachVolumeTestJSON-104526531 Sep 16 10:02:56.221458 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Role: reader,member Sep 16 10:02:56.221458 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Roles: reader,member Sep 16 10:02:56.223011 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/75e9f7169b754d5daa040eb465e858e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_75e9f7169b754d5daa040eb465e858e5", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/75e9f7169b754d5daa040eb465e858e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/75e9f7169b754d5daa040eb465e858e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 10:02:56.223011 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-AttachVolumeTestJSON-104526531 Sep 16 10:02:56.223011 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Id: 75e9f7169b754d5daa040eb465e858e5 Sep 16 10:02:56.223011 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-AttachVolumeTestJSON-104526531 Sep 16 10:02:56.223011 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User: tempest-AttachVolumeTestJSON-104526531-project Sep 16 10:02:56.223011 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Sep 16 10:02:56.223011 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Sep 16 10:02:56.223011 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Id: 6ffd25afbc1b42c995ff96c21221b310 Sep 16 10:02:56.223011 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-AttachVolumeTestJSON-104526531-project Sep 16 10:02:56.223011 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: method: > Sep 16 10:02:56.223011 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: exception: Instance 34302fd9-9a71-41c1-8392-6b9df5f0f75e could not be found. Sep 16 10:02:56.223011 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: action_args: {'id': '34302fd9-9a71-41c1-8392-6b9df5f0f75e'} Sep 16 10:02:56.223987 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 10:02:56.223987 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 10:02:56.223987 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 10:02:56.223987 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 10:02:56.223987 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 10:02:56.223987 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 10:02:56.223987 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 10:02:56.223987 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 10:02:56.223987 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 10:02:56.223987 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 10:02:56.223987 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34302fd9-9a71-41c1-8392-6b9df5f0f75e could not be found. Sep 16 10:02:56.223987 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 10:02:56.223987 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 10:02:56.223987 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 10:02:56.223987 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 10:02:56.223987 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 10:02:56.223987 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 10:02:56.223987 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 10:02:56.223987 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 10:02:56.223987 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 10:02:56.225690 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 10:02:56.225690 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 10:02:56.225690 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 10:02:56.225690 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 10:02:56.225690 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 10:02:56.225690 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 10:02:56.225690 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 10:02:56.225690 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34302fd9-9a71-41c1-8392-6b9df5f0f75e could not be found. Sep 16 10:02:56.225690 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 10:02:56.225690 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 10:02:56.225690 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 10:02:56.225690 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 10:02:56.225690 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 10:02:56.225690 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 10:02:56.225690 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 10:02:56.225690 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 10:02:56.225690 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34302fd9-9a71-41c1-8392-6b9df5f0f75e could not be found. Sep 16 10:02:56.225690 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 10:02:56.227281 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-b617fdc3-827a-4a1a-9cbe-5c955cfe097a tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] Returning 404 to user: Instance 34302fd9-9a71-41c1-8392-6b9df5f0f75e could not be found. {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 10:02:56.227281 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-b617fdc3-827a-4a1a-9cbe-5c955cfe097a tempest-AttachVolumeTestJSON-104526531 tempest-AttachVolumeTestJSON-104526531-project] 10.222.0.73 "GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e" status: 404 len: 111 microversion: 2.1 time: 0.030820 Sep 16 10:02:56.227281 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 581/1160] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:02:56 2022] GET /compute/v2.1/servers/34302fd9-9a71-41c1-8392-6b9df5f0f75e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 10:02:56.239423 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-ce544b79-aeca-4072-8370-cc32e66b1bdd tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff870e07952c4e049e17a096c477165b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e292a400454c93a48aca5510bfcee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:02:56.247344 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-ce544b79-aeca-4072-8370-cc32e66b1bdd tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25" status: 200 len: 1569 microversion: 2.1 time: 0.167057 Sep 16 10:02:56.247909 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 580/1161] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:02:56 2022] GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:02:56.878209 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-a49b5ec2-f229-411d-a9d3-e594ab61fb96 req-d44d5965-dfd9-42ec-be0f-33909e61d08d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70372e0b-76cc-4156-84ae-3734dd9f7b25", "name": "network-vif-deleted", "tag": "cc7b6bd5-7e7c-4cc5-8097-75cfcd4c3ad8"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 10:02:56.903521 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-a49b5ec2-f229-411d-a9d3-e594ab61fb96 req-d44d5965-dfd9-42ec-be0f-33909e61d08d service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:56.904391 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-a49b5ec2-f229-411d-a9d3-e594ab61fb96 req-d44d5965-dfd9-42ec-be0f-33909e61d08d service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:56.905218 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-a49b5ec2-f229-411d-a9d3-e594ab61fb96 req-d44d5965-dfd9-42ec-be0f-33909e61d08d service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:56.925997 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-a49b5ec2-f229-411d-a9d3-e594ab61fb96 req-d44d5965-dfd9-42ec-be0f-33909e61d08d service nova] Creating event network-vif-deleted:cc7b6bd5-7e7c-4cc5-8097-75cfcd4c3ad8 for instance 70372e0b-76cc-4156-84ae-3734dd9f7b25 on hv-cinder-79053 Sep 16 10:02:56.934699 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-a49b5ec2-f229-411d-a9d3-e594ab61fb96 req-d44d5965-dfd9-42ec-be0f-33909e61d08d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063360 Sep 16 10:02:56.942954 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 582/1162] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 10:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 10:02:57.273100 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-f87300e2-901f-4518-88b4-4c9f3cc84139 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:02:57.274459 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-f87300e2-901f-4518-88b4-4c9f3cc84139 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:02:57.287693 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f87300e2-901f-4518-88b4-4c9f3cc84139 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:57.289052 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f87300e2-901f-4518-88b4-4c9f3cc84139 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:57.289421 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f87300e2-901f-4518-88b4-4c9f3cc84139 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:57.290543 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f87300e2-901f-4518-88b4-4c9f3cc84139 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:57.291260 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f87300e2-901f-4518-88b4-4c9f3cc84139 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:57.291785 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f87300e2-901f-4518-88b4-4c9f3cc84139 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:57.419674 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-f87300e2-901f-4518-88b4-4c9f3cc84139 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff870e07952c4e049e17a096c477165b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e292a400454c93a48aca5510bfcee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:02:57.429227 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-f87300e2-901f-4518-88b4-4c9f3cc84139 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25" status: 200 len: 1219 microversion: 2.1 time: 0.161097 Sep 16 10:02:57.430104 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 581/1163] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:02:57 2022] GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25 => generated 1219 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:02:58.454224 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d47ddb33-a101-4219-b740-75fa358a8069 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:02:58.455043 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-d47ddb33-a101-4219-b740-75fa358a8069 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] [instance: 70372e0b-76cc-4156-84ae-3734dd9f7b25] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:02:58.462557 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d47ddb33-a101-4219-b740-75fa358a8069 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:58.463178 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d47ddb33-a101-4219-b740-75fa358a8069 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:58.463767 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d47ddb33-a101-4219-b740-75fa358a8069 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:58.464541 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d47ddb33-a101-4219-b740-75fa358a8069 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:02:58.465006 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d47ddb33-a101-4219-b740-75fa358a8069 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:02:58.465521 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d47ddb33-a101-4219-b740-75fa358a8069 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:02:58.482456 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.wsgi [None req-d47ddb33-a101-4219-b740-75fa358a8069 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] HTTP exception thrown: Instance 70372e0b-76cc-4156-84ae-3734dd9f7b25 could not be found. Sep 16 10:02:58.484134 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d47ddb33-a101-4219-b740-75fa358a8069 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Request method failure captured: Sep 16 10:02:58.484134 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: request: GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25 HTTP/1.1 Sep 16 10:02:58.484134 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept: application/json Sep 16 10:02:58.484134 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Sep 16 10:02:58.484134 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Connection: close Sep 16 10:02:58.484134 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Length: 0 Sep 16 10:02:58.484134 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Type: application/json Sep 16 10:02:58.484134 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Host: 10.222.0.73 Sep 16 10:02:58.484134 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Sep 16 10:02:58.484134 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Sep 16 10:02:58.484134 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjJEi6ijMwWDOQdnPFEplTF4jbJMO41U6rMvFRGnhY8DSHplOMKc7pm2yF6dLWO26wqhzinRvQsvRvKAQc5EyuxGfLI303AoA-tjEPqgmWPBIC--dBrNLef9gMjSgtP13LK_5seTdVHx41HRpZUsJSH35sqONXLeCWUkN-dzNwPYd9CmE Sep 16 10:02:58.484134 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Sep 16 10:02:58.484134 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Sep 16 10:02:58.484134 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Sep 16 10:02:58.484134 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Sep 16 10:02:58.484134 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Sep 16 10:02:58.484134 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Sep 16 10:02:58.484134 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Id: 92e292a400454c93a48aca5510bfcee9 Sep 16 10:02:58.484134 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-TestShelveInstance-1086613359 Sep 16 10:02:58.484134 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Role: reader,member Sep 16 10:02:58.484134 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Roles: reader,member Sep 16 10:02:58.486390 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/92e292a400454c93a48aca5510bfcee9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_92e292a400454c93a48aca5510bfcee9", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/92e292a400454c93a48aca5510bfcee9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/92e292a400454c93a48aca5510bfcee9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 10:02:58.486390 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-TestShelveInstance-1086613359 Sep 16 10:02:58.486390 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Id: 92e292a400454c93a48aca5510bfcee9 Sep 16 10:02:58.486390 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-TestShelveInstance-1086613359 Sep 16 10:02:58.486390 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User: tempest-TestShelveInstance-1086613359-project Sep 16 10:02:58.486390 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Sep 16 10:02:58.486390 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Sep 16 10:02:58.486390 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Id: ff870e07952c4e049e17a096c477165b Sep 16 10:02:58.486390 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-TestShelveInstance-1086613359-project Sep 16 10:02:58.486390 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: method: > Sep 16 10:02:58.486390 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: exception: Instance 70372e0b-76cc-4156-84ae-3734dd9f7b25 could not be found. Sep 16 10:02:58.486390 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: action_args: {'id': '70372e0b-76cc-4156-84ae-3734dd9f7b25'} Sep 16 10:02:58.487490 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 10:02:58.487490 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 10:02:58.487490 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 10:02:58.487490 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 10:02:58.487490 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 10:02:58.487490 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 10:02:58.487490 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 10:02:58.487490 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 10:02:58.487490 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 10:02:58.487490 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 10:02:58.487490 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70372e0b-76cc-4156-84ae-3734dd9f7b25 could not be found. Sep 16 10:02:58.487490 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 10:02:58.487490 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 10:02:58.487490 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 10:02:58.487490 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 10:02:58.487490 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 10:02:58.487490 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 10:02:58.487490 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 10:02:58.487490 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 10:02:58.487490 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 10:02:58.489123 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 10:02:58.489123 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 10:02:58.489123 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 10:02:58.489123 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 10:02:58.489123 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 10:02:58.489123 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 10:02:58.489123 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 10:02:58.489123 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70372e0b-76cc-4156-84ae-3734dd9f7b25 could not be found. Sep 16 10:02:58.489123 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 10:02:58.489123 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 10:02:58.489123 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 10:02:58.489123 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 10:02:58.489123 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 10:02:58.489123 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 10:02:58.489123 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 10:02:58.489123 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 10:02:58.489123 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70372e0b-76cc-4156-84ae-3734dd9f7b25 could not be found. Sep 16 10:02:58.489123 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 10:02:58.490539 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d47ddb33-a101-4219-b740-75fa358a8069 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Returning 404 to user: Instance 70372e0b-76cc-4156-84ae-3734dd9f7b25 could not be found. {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 10:02:58.490539 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-d47ddb33-a101-4219-b740-75fa358a8069 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25" status: 404 len: 111 microversion: 2.1 time: 0.037036 Sep 16 10:02:58.490539 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 583/1164] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:02:58 2022] GET /compute/v2.1/servers/70372e0b-76cc-4156-84ae-3734dd9f7b25 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 10:02:58.740817 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-37f61516-1a92-4e00-b005-a870de5a48d3 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] Calling method '.version_select at 0x7ffa6dcc3ee0>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:02:58.832277 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-37f61516-1a92-4e00-b005-a870de5a48d3 tempest-TestShelveInstance-1086613359 tempest-TestShelveInstance-1086613359-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-222180959" status: 202 len: 0 microversion: 2.1 time: 0.095285 Sep 16 10:02:58.836641 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 582/1165] 10.222.0.73 () {58 vars in 1251 bytes} [Fri Sep 16 10:02:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-222180959 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 10:03:21.516220 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_api:SELECT=15 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 10:03:21.516996 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=19 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 10:03:21.686462 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-283a4ee1-4386-4091-81a5-d80784fda827 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Action: 'create', calling method: .version_select at 0x7ffa6df56b80>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-415399696", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApidzY6652UoCDkeJOKLGIxbm8FPG/Zo0/1VhI8gMxO5lbEUt1RXvQFtyuc/mMuZwnPoRtJPkB/x6fnbrPeIcmWlXz/T/V96peqR6h9E0oPqTPoWZpgYMrRDZp5fwOavw=="}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 10:03:21.711416 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-283a4ee1-4386-4091-81a5-d80784fda827 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Getting quotas for project aaeb5ec036dd43479e9b66290a29d6d5. Resources: {'key_pairs'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 10:03:21.716992 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-283a4ee1-4386-4091-81a5-d80784fda827 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Getting quotas for user f2747c55351847dbb66f29c992dd62aa and project aaeb5ec036dd43479e9b66290a29d6d5. Resources: {'key_pairs'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 10:03:21.836979 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-283a4ee1-4386-4091-81a5-d80784fda827 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.323303 Sep 16 10:03:21.837958 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 584/1166] 10.222.0.73 () {60 vars in 1159 bytes} [Fri Sep 16 10:03:21 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 10:03:42.346092 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 10:03:42.346797 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 10:03:42.351021 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-88c56675-cf57-42bb-9eed-e4a48722e166 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-919236813", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-415399696", "security_groups": [{"name": "tempest-secgroup-smoke-283210283"}], "block_device_mapping_v2": [{"uuid": "54c564ee-e938-447a-8ae4-9886f58165b2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "15128754-481d-4580-9909-e9d7f17bf2e9"}]}} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 10:03:42.467898 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.network.neutron [None req-88c56675-cf57-42bb-9eed-e4a48722e166 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] validate_networks() for [('15128754-481d-4580-9909-e9d7f17bf2e9', None, None, None, None, None)] {{(pid=127671) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 10:03:42.940449 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.virt.hardware [None req-88c56675-cf57-42bb-9eed-e4a48722e166 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Flavor limits 0:0:0 {{(pid=127671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 10:03:42.940872 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.virt.hardware [None req-88c56675-cf57-42bb-9eed-e4a48722e166 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Image limits 0:0:0 {{(pid=127671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 10:03:42.941378 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.virt.hardware [None req-88c56675-cf57-42bb-9eed-e4a48722e166 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Flavor pref 0:0:0 {{(pid=127671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 10:03:42.941817 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.virt.hardware [None req-88c56675-cf57-42bb-9eed-e4a48722e166 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Image pref 0:0:0 {{(pid=127671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 10:03:42.942230 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.virt.hardware [None req-88c56675-cf57-42bb-9eed-e4a48722e166 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 10:03:42.951067 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-88c56675-cf57-42bb-9eed-e4a48722e166 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:03:42.951545 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-88c56675-cf57-42bb-9eed-e4a48722e166 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:03:42.951977 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-88c56675-cf57-42bb-9eed-e4a48722e166 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:03:42.952702 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-88c56675-cf57-42bb-9eed-e4a48722e166 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:03:42.953155 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-88c56675-cf57-42bb-9eed-e4a48722e166 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:03:42.956428 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-88c56675-cf57-42bb-9eed-e4a48722e166 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:03:42.974014 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.quota [None req-88c56675-cf57-42bb-9eed-e4a48722e166 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Getting quotas for project aaeb5ec036dd43479e9b66290a29d6d5. Resources: {'instances', 'cores', 'ram'} {{(pid=127671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 10:03:42.978574 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.quota [None req-88c56675-cf57-42bb-9eed-e4a48722e166 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Getting quotas for user f2747c55351847dbb66f29c992dd62aa and project aaeb5ec036dd43479e9b66290a29d6d5. Resources: {'instances', 'cores', 'ram'} {{(pid=127671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 10:03:43.043550 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-88c56675-cf57-42bb-9eed-e4a48722e166 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Going to run 1 instances... {{(pid=127671) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 10:03:43.045764 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-88c56675-cf57-42bb-9eed-e4a48722e166 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: aafaedae-d0a6-456e-914f-488bd3cf2feb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='54c564ee-e938-447a-8ae4-9886f58165b2',volume_size=None,volume_type=None)] {{(pid=127671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 10:03:43.519401 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-88c56675-cf57-42bb-9eed-e4a48722e166 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.175023 Sep 16 10:03:43.522086 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 583/1167] 10.222.0.73 () {60 vars in 1147 bytes} [Fri Sep 16 10:03:42 2022] POST /compute/v2.1/servers => generated 405 bytes in 1176 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 10:03:43.528765 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell0:SELECT=4 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 10:03:43.529687 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 10:03:43.534280 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-45f712e0-a93b-49e3-9313-98ee85abad4b tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:03:43.534880 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-45f712e0-a93b-49e3-9313-98ee85abad4b tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: aafaedae-d0a6-456e-914f-488bd3cf2feb] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:03:43.589377 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-45f712e0-a93b-49e3-9313-98ee85abad4b tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:03:43.598280 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-45f712e0-a93b-49e3-9313-98ee85abad4b tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/aafaedae-d0a6-456e-914f-488bd3cf2feb" status: 200 len: 1093 microversion: 2.1 time: 0.070897 Sep 16 10:03:43.601092 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 585/1168] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:03:43 2022] GET /compute/v2.1/servers/aafaedae-d0a6-456e-914f-488bd3cf2feb => generated 1093 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 10:03:44.622609 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-d583cc94-edc2-4be0-9538-f49e5a3d3554 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:03:44.623138 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-d583cc94-edc2-4be0-9538-f49e5a3d3554 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: aafaedae-d0a6-456e-914f-488bd3cf2feb] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:03:44.641969 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d583cc94-edc2-4be0-9538-f49e5a3d3554 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:03:44.641969 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d583cc94-edc2-4be0-9538-f49e5a3d3554 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:03:44.641969 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d583cc94-edc2-4be0-9538-f49e5a3d3554 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:03:44.641969 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d583cc94-edc2-4be0-9538-f49e5a3d3554 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:03:44.642354 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d583cc94-edc2-4be0-9538-f49e5a3d3554 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:03:44.642354 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d583cc94-edc2-4be0-9538-f49e5a3d3554 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:03:44.698411 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-d583cc94-edc2-4be0-9538-f49e5a3d3554 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:03:44.706749 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-d583cc94-edc2-4be0-9538-f49e5a3d3554 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/aafaedae-d0a6-456e-914f-488bd3cf2feb" status: 200 len: 1143 microversion: 2.1 time: 0.088672 Sep 16 10:03:44.707315 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 584/1169] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:03:44 2022] GET /compute/v2.1/servers/aafaedae-d0a6-456e-914f-488bd3cf2feb => generated 1143 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:03:45.732299 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-db0470ed-c991-4455-bc83-770b731a653a tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:03:45.732937 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-db0470ed-c991-4455-bc83-770b731a653a tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: aafaedae-d0a6-456e-914f-488bd3cf2feb] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:03:45.742079 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-db0470ed-c991-4455-bc83-770b731a653a tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:03:45.742656 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-db0470ed-c991-4455-bc83-770b731a653a tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:03:45.743105 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-db0470ed-c991-4455-bc83-770b731a653a tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:03:45.744085 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-db0470ed-c991-4455-bc83-770b731a653a tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:03:45.744549 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-db0470ed-c991-4455-bc83-770b731a653a tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:03:45.745092 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-db0470ed-c991-4455-bc83-770b731a653a tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:03:45.822978 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-db0470ed-c991-4455-bc83-770b731a653a tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:03:45.832179 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-db0470ed-c991-4455-bc83-770b731a653a tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/aafaedae-d0a6-456e-914f-488bd3cf2feb" status: 200 len: 1199 microversion: 2.1 time: 0.103789 Sep 16 10:03:45.848516 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 586/1170] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:03:45 2022] GET /compute/v2.1/servers/aafaedae-d0a6-456e-914f-488bd3cf2feb => generated 1199 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:03:46.856034 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-8859aa7f-59aa-435c-bdc2-4a83b0a59111 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:03:46.856682 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-8859aa7f-59aa-435c-bdc2-4a83b0a59111 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: aafaedae-d0a6-456e-914f-488bd3cf2feb] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:03:46.864310 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8859aa7f-59aa-435c-bdc2-4a83b0a59111 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:03:46.864805 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8859aa7f-59aa-435c-bdc2-4a83b0a59111 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:03:46.865251 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8859aa7f-59aa-435c-bdc2-4a83b0a59111 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:03:46.866008 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8859aa7f-59aa-435c-bdc2-4a83b0a59111 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:03:46.866466 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8859aa7f-59aa-435c-bdc2-4a83b0a59111 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:03:46.866897 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-8859aa7f-59aa-435c-bdc2-4a83b0a59111 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:03:47.008689 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-8859aa7f-59aa-435c-bdc2-4a83b0a59111 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:03:47.016327 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-8859aa7f-59aa-435c-bdc2-4a83b0a59111 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/aafaedae-d0a6-456e-914f-488bd3cf2feb" status: 200 len: 1276 microversion: 2.1 time: 0.164227 Sep 16 10:03:47.017052 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 585/1171] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:03:46 2022] GET /compute/v2.1/servers/aafaedae-d0a6-456e-914f-488bd3cf2feb => generated 1276 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:03:47.409398 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-3eaae00b-4950-490b-8089-48ba8ec4a0ce req-ef6a6245-8635-4876-8784-00d55ebb881e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aafaedae-d0a6-456e-914f-488bd3cf2feb", "tag": "85465582-8090-4f05-b0f7-bc4e3bf7fac7"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 10:03:47.419388 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-3eaae00b-4950-490b-8089-48ba8ec4a0ce req-ef6a6245-8635-4876-8784-00d55ebb881e service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:03:47.419858 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-3eaae00b-4950-490b-8089-48ba8ec4a0ce req-ef6a6245-8635-4876-8784-00d55ebb881e service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:03:47.420284 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-3eaae00b-4950-490b-8089-48ba8ec4a0ce req-ef6a6245-8635-4876-8784-00d55ebb881e service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:03:47.431214 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-3eaae00b-4950-490b-8089-48ba8ec4a0ce req-ef6a6245-8635-4876-8784-00d55ebb881e service nova] Creating event network-changed:85465582-8090-4f05-b0f7-bc4e3bf7fac7 for instance aafaedae-d0a6-456e-914f-488bd3cf2feb on hv-cinder-79053 Sep 16 10:03:47.436592 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-3eaae00b-4950-490b-8089-48ba8ec4a0ce req-ef6a6245-8635-4876-8784-00d55ebb881e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030674 Sep 16 10:03:47.437492 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 587/1172] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 10:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 10:03:48.039853 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-d3fa2512-37ee-47c5-a3ad-eee2a3451139 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:03:48.040467 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-d3fa2512-37ee-47c5-a3ad-eee2a3451139 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: aafaedae-d0a6-456e-914f-488bd3cf2feb] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:03:48.046994 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d3fa2512-37ee-47c5-a3ad-eee2a3451139 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:03:48.048054 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d3fa2512-37ee-47c5-a3ad-eee2a3451139 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:03:48.048498 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d3fa2512-37ee-47c5-a3ad-eee2a3451139 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:03:48.049193 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d3fa2512-37ee-47c5-a3ad-eee2a3451139 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:03:48.049673 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d3fa2512-37ee-47c5-a3ad-eee2a3451139 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:03:48.050102 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d3fa2512-37ee-47c5-a3ad-eee2a3451139 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:03:48.188199 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-d3fa2512-37ee-47c5-a3ad-eee2a3451139 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:03:48.195891 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-d3fa2512-37ee-47c5-a3ad-eee2a3451139 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/aafaedae-d0a6-456e-914f-488bd3cf2feb" status: 200 len: 1264 microversion: 2.1 time: 0.159928 Sep 16 10:03:48.196455 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 586/1173] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:03:48 2022] GET /compute/v2.1/servers/aafaedae-d0a6-456e-914f-488bd3cf2feb => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:03:49.219087 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-854d2536-aa28-4fe1-bc08-e66d9183facf tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:03:49.219966 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-854d2536-aa28-4fe1-bc08-e66d9183facf tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: aafaedae-d0a6-456e-914f-488bd3cf2feb] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:03:49.226966 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-854d2536-aa28-4fe1-bc08-e66d9183facf tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:03:49.227456 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-854d2536-aa28-4fe1-bc08-e66d9183facf tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:03:49.227895 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-854d2536-aa28-4fe1-bc08-e66d9183facf tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:03:49.228598 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-854d2536-aa28-4fe1-bc08-e66d9183facf tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:03:49.229054 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-854d2536-aa28-4fe1-bc08-e66d9183facf tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:03:49.229485 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-854d2536-aa28-4fe1-bc08-e66d9183facf tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:03:49.363198 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-854d2536-aa28-4fe1-bc08-e66d9183facf tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:03:49.371105 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-854d2536-aa28-4fe1-bc08-e66d9183facf tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/aafaedae-d0a6-456e-914f-488bd3cf2feb" status: 200 len: 1264 microversion: 2.1 time: 0.156582 Sep 16 10:03:49.371694 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 588/1174] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:03:49 2022] GET /compute/v2.1/servers/aafaedae-d0a6-456e-914f-488bd3cf2feb => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:03:50.395208 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-75ae21a6-2234-4165-99cf-6ccd5c744195 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:03:50.395812 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-75ae21a6-2234-4165-99cf-6ccd5c744195 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: aafaedae-d0a6-456e-914f-488bd3cf2feb] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:03:50.402149 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-75ae21a6-2234-4165-99cf-6ccd5c744195 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:03:50.402626 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-75ae21a6-2234-4165-99cf-6ccd5c744195 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:03:50.403059 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-75ae21a6-2234-4165-99cf-6ccd5c744195 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:03:50.403741 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-75ae21a6-2234-4165-99cf-6ccd5c744195 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:03:50.404189 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-75ae21a6-2234-4165-99cf-6ccd5c744195 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:03:50.404607 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-75ae21a6-2234-4165-99cf-6ccd5c744195 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:03:50.536943 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-75ae21a6-2234-4165-99cf-6ccd5c744195 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:03:50.544599 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-75ae21a6-2234-4165-99cf-6ccd5c744195 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/aafaedae-d0a6-456e-914f-488bd3cf2feb" status: 200 len: 1264 microversion: 2.1 time: 0.153851 Sep 16 10:03:50.545156 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 587/1175] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:03:50 2022] GET /compute/v2.1/servers/aafaedae-d0a6-456e-914f-488bd3cf2feb => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:03:51.568134 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-64db7340-7764-4ccf-9728-7a525d6a5b33 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:03:51.568754 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-64db7340-7764-4ccf-9728-7a525d6a5b33 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: aafaedae-d0a6-456e-914f-488bd3cf2feb] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:03:51.575226 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-64db7340-7764-4ccf-9728-7a525d6a5b33 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:03:51.575713 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-64db7340-7764-4ccf-9728-7a525d6a5b33 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:03:51.576156 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-64db7340-7764-4ccf-9728-7a525d6a5b33 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:03:51.576850 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-64db7340-7764-4ccf-9728-7a525d6a5b33 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:03:51.577308 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-64db7340-7764-4ccf-9728-7a525d6a5b33 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:03:51.577772 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-64db7340-7764-4ccf-9728-7a525d6a5b33 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:03:51.710356 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-64db7340-7764-4ccf-9728-7a525d6a5b33 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:03:51.718219 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-64db7340-7764-4ccf-9728-7a525d6a5b33 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/aafaedae-d0a6-456e-914f-488bd3cf2feb" status: 200 len: 1264 microversion: 2.1 time: 0.153938 Sep 16 10:03:51.718781 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 589/1176] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:03:51 2022] GET /compute/v2.1/servers/aafaedae-d0a6-456e-914f-488bd3cf2feb => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:03:52.745207 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-b73e260a-d6bd-4853-b9d6-53844a99d9be tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:03:52.745207 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-b73e260a-d6bd-4853-b9d6-53844a99d9be tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: aafaedae-d0a6-456e-914f-488bd3cf2feb] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:03:52.748533 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b73e260a-d6bd-4853-b9d6-53844a99d9be tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:03:52.749015 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b73e260a-d6bd-4853-b9d6-53844a99d9be tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:03:52.749999 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b73e260a-d6bd-4853-b9d6-53844a99d9be tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:03:52.750740 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b73e260a-d6bd-4853-b9d6-53844a99d9be tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:03:52.751208 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b73e260a-d6bd-4853-b9d6-53844a99d9be tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:03:52.751629 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-b73e260a-d6bd-4853-b9d6-53844a99d9be tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:03:52.880584 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-b73e260a-d6bd-4853-b9d6-53844a99d9be tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:03:52.888226 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-b73e260a-d6bd-4853-b9d6-53844a99d9be tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/aafaedae-d0a6-456e-914f-488bd3cf2feb" status: 200 len: 1264 microversion: 2.1 time: 0.150914 Sep 16 10:03:52.888787 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 588/1177] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:03:52 2022] GET /compute/v2.1/servers/aafaedae-d0a6-456e-914f-488bd3cf2feb => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:03:53.911818 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-70b6c0bc-9107-4c60-8e6f-34ce3660e0cb tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:03:53.912354 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-70b6c0bc-9107-4c60-8e6f-34ce3660e0cb tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: aafaedae-d0a6-456e-914f-488bd3cf2feb] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:03:53.918778 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-70b6c0bc-9107-4c60-8e6f-34ce3660e0cb tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:03:53.919266 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-70b6c0bc-9107-4c60-8e6f-34ce3660e0cb tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:03:53.919701 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-70b6c0bc-9107-4c60-8e6f-34ce3660e0cb tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:03:53.920383 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-70b6c0bc-9107-4c60-8e6f-34ce3660e0cb tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:03:53.920837 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-70b6c0bc-9107-4c60-8e6f-34ce3660e0cb tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:03:53.921257 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-70b6c0bc-9107-4c60-8e6f-34ce3660e0cb tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:03:54.051481 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-70b6c0bc-9107-4c60-8e6f-34ce3660e0cb tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:03:54.059062 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-70b6c0bc-9107-4c60-8e6f-34ce3660e0cb tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/aafaedae-d0a6-456e-914f-488bd3cf2feb" status: 200 len: 1264 microversion: 2.1 time: 0.151242 Sep 16 10:03:54.059619 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 590/1178] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:03:53 2022] GET /compute/v2.1/servers/aafaedae-d0a6-456e-914f-488bd3cf2feb => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:03:55.082630 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-e59c0fca-0c9d-431d-93c5-09ede4cc8dda tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:03:55.083290 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-e59c0fca-0c9d-431d-93c5-09ede4cc8dda tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: aafaedae-d0a6-456e-914f-488bd3cf2feb] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:03:55.085362 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell0:SELECT=2 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 10:03:55.086043 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell0:SELECT=6 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 10:03:55.091287 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e59c0fca-0c9d-431d-93c5-09ede4cc8dda tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:03:55.091768 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e59c0fca-0c9d-431d-93c5-09ede4cc8dda tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:03:55.092458 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e59c0fca-0c9d-431d-93c5-09ede4cc8dda tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:03:55.093172 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e59c0fca-0c9d-431d-93c5-09ede4cc8dda tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:03:55.093651 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e59c0fca-0c9d-431d-93c5-09ede4cc8dda tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:03:55.094093 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e59c0fca-0c9d-431d-93c5-09ede4cc8dda tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:03:55.224537 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-e59c0fca-0c9d-431d-93c5-09ede4cc8dda tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:03:55.232120 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-e59c0fca-0c9d-431d-93c5-09ede4cc8dda tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/aafaedae-d0a6-456e-914f-488bd3cf2feb" status: 200 len: 1264 microversion: 2.1 time: 0.153866 Sep 16 10:03:55.232692 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 589/1179] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:03:55 2022] GET /compute/v2.1/servers/aafaedae-d0a6-456e-914f-488bd3cf2feb => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 10:03:56.253469 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d10e13bd-9675-4aea-b0a0-4224524eec61 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:03:56.254131 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-d10e13bd-9675-4aea-b0a0-4224524eec61 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: aafaedae-d0a6-456e-914f-488bd3cf2feb] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:03:56.256567 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell0:SELECT=2 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 10:03:56.261305 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d10e13bd-9675-4aea-b0a0-4224524eec61 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:03:56.261857 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d10e13bd-9675-4aea-b0a0-4224524eec61 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:03:56.262349 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d10e13bd-9675-4aea-b0a0-4224524eec61 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:03:56.263044 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d10e13bd-9675-4aea-b0a0-4224524eec61 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:03:56.263555 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d10e13bd-9675-4aea-b0a0-4224524eec61 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:03:56.263983 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d10e13bd-9675-4aea-b0a0-4224524eec61 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:03:56.396345 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-d10e13bd-9675-4aea-b0a0-4224524eec61 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:03:56.404107 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-d10e13bd-9675-4aea-b0a0-4224524eec61 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/aafaedae-d0a6-456e-914f-488bd3cf2feb" status: 200 len: 1264 microversion: 2.1 time: 0.154535 Sep 16 10:03:56.404673 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 591/1180] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:03:56 2022] GET /compute/v2.1/servers/aafaedae-d0a6-456e-914f-488bd3cf2feb => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:03:57.427435 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-f7dbc25d-1ecf-45da-837c-ed9e69a0cfc0 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:03:57.428111 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-f7dbc25d-1ecf-45da-837c-ed9e69a0cfc0 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: aafaedae-d0a6-456e-914f-488bd3cf2feb] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:03:57.434561 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f7dbc25d-1ecf-45da-837c-ed9e69a0cfc0 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:03:57.435040 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f7dbc25d-1ecf-45da-837c-ed9e69a0cfc0 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:03:57.435476 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f7dbc25d-1ecf-45da-837c-ed9e69a0cfc0 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:03:57.436156 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f7dbc25d-1ecf-45da-837c-ed9e69a0cfc0 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:03:57.436612 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f7dbc25d-1ecf-45da-837c-ed9e69a0cfc0 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:03:57.437033 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f7dbc25d-1ecf-45da-837c-ed9e69a0cfc0 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:03:57.695125 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-f7dbc25d-1ecf-45da-837c-ed9e69a0cfc0 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:03:57.695125 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-f7dbc25d-1ecf-45da-837c-ed9e69a0cfc0 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/aafaedae-d0a6-456e-914f-488bd3cf2feb" status: 200 len: 1264 microversion: 2.1 time: 0.164183 Sep 16 10:03:57.695125 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 590/1181] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:03:57 2022] GET /compute/v2.1/servers/aafaedae-d0a6-456e-914f-488bd3cf2feb => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:03:57.867362 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-304abf6a-5f53-46b9-8f68-cba5fcae3435 req-9b710e91-21d8-4f07-b31e-2fd1b2c38ac9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aafaedae-d0a6-456e-914f-488bd3cf2feb", "name": "network-vif-plugged", "status": "completed", "tag": "85465582-8090-4f05-b0f7-bc4e3bf7fac7"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 10:03:57.877250 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-304abf6a-5f53-46b9-8f68-cba5fcae3435 req-9b710e91-21d8-4f07-b31e-2fd1b2c38ac9 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:03:57.878180 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-304abf6a-5f53-46b9-8f68-cba5fcae3435 req-9b710e91-21d8-4f07-b31e-2fd1b2c38ac9 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:03:57.878790 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-304abf6a-5f53-46b9-8f68-cba5fcae3435 req-9b710e91-21d8-4f07-b31e-2fd1b2c38ac9 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:03:57.889335 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-304abf6a-5f53-46b9-8f68-cba5fcae3435 req-9b710e91-21d8-4f07-b31e-2fd1b2c38ac9 service nova] Creating event network-vif-plugged:85465582-8090-4f05-b0f7-bc4e3bf7fac7 for instance aafaedae-d0a6-456e-914f-488bd3cf2feb on hv-cinder-79053 Sep 16 10:03:57.894731 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-304abf6a-5f53-46b9-8f68-cba5fcae3435 req-9b710e91-21d8-4f07-b31e-2fd1b2c38ac9 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031480 Sep 16 10:03:57.897929 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 592/1182] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 10:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 10:03:58.640945 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-9eab734c-c74f-48c5-8600-1984c996b51d tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:03:58.641568 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-9eab734c-c74f-48c5-8600-1984c996b51d tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: aafaedae-d0a6-456e-914f-488bd3cf2feb] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:03:58.648482 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9eab734c-c74f-48c5-8600-1984c996b51d tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:03:58.648963 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9eab734c-c74f-48c5-8600-1984c996b51d tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:03:58.649403 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9eab734c-c74f-48c5-8600-1984c996b51d tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:03:58.650116 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9eab734c-c74f-48c5-8600-1984c996b51d tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:03:58.650566 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9eab734c-c74f-48c5-8600-1984c996b51d tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:03:58.650989 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9eab734c-c74f-48c5-8600-1984c996b51d tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:03:58.780847 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-9eab734c-c74f-48c5-8600-1984c996b51d tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:03:58.789185 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-9eab734c-c74f-48c5-8600-1984c996b51d tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/aafaedae-d0a6-456e-914f-488bd3cf2feb" status: 200 len: 1264 microversion: 2.1 time: 0.152089 Sep 16 10:03:58.789771 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 591/1183] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:03:58 2022] GET /compute/v2.1/servers/aafaedae-d0a6-456e-914f-488bd3cf2feb => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:03:59.813114 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-27a6c5cd-3713-456b-a4df-015f318ec1af tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:03:59.813863 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-27a6c5cd-3713-456b-a4df-015f318ec1af tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: aafaedae-d0a6-456e-914f-488bd3cf2feb] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:03:59.819871 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-27a6c5cd-3713-456b-a4df-015f318ec1af tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:03:59.820353 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-27a6c5cd-3713-456b-a4df-015f318ec1af tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:03:59.820786 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-27a6c5cd-3713-456b-a4df-015f318ec1af tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:03:59.821471 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-27a6c5cd-3713-456b-a4df-015f318ec1af tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:03:59.821950 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-27a6c5cd-3713-456b-a4df-015f318ec1af tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:03:59.822374 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-27a6c5cd-3713-456b-a4df-015f318ec1af tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:03:59.952640 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-27a6c5cd-3713-456b-a4df-015f318ec1af tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:03:59.961241 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-27a6c5cd-3713-456b-a4df-015f318ec1af tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/aafaedae-d0a6-456e-914f-488bd3cf2feb" status: 200 len: 1451 microversion: 2.1 time: 0.152812 Sep 16 10:03:59.967471 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 593/1184] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:03:59 2022] GET /compute/v2.1/servers/aafaedae-d0a6-456e-914f-488bd3cf2feb => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:03:59.983329 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-f782c0e4-5a64-46d3-8f2e-9477fec3f947 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:03:59.984030 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-f782c0e4-5a64-46d3-8f2e-9477fec3f947 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: aafaedae-d0a6-456e-914f-488bd3cf2feb] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:03:59.990452 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f782c0e4-5a64-46d3-8f2e-9477fec3f947 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:03:59.990930 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f782c0e4-5a64-46d3-8f2e-9477fec3f947 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:03:59.991390 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f782c0e4-5a64-46d3-8f2e-9477fec3f947 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:03:59.992075 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f782c0e4-5a64-46d3-8f2e-9477fec3f947 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:03:59.992566 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f782c0e4-5a64-46d3-8f2e-9477fec3f947 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:03:59.993050 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f782c0e4-5a64-46d3-8f2e-9477fec3f947 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:04:00.124059 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-f782c0e4-5a64-46d3-8f2e-9477fec3f947 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:04:00.132607 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-f782c0e4-5a64-46d3-8f2e-9477fec3f947 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/aafaedae-d0a6-456e-914f-488bd3cf2feb" status: 200 len: 1451 microversion: 2.1 time: 0.153096 Sep 16 10:04:00.133184 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 592/1185] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:03:59 2022] GET /compute/v2.1/servers/aafaedae-d0a6-456e-914f-488bd3cf2feb => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:04:02.614302 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-ad70cafb-8f6c-43a9-9fce-43c69b5f9be5 req-6f991d8b-d582-4d66-b7fb-68abc564b474 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aafaedae-d0a6-456e-914f-488bd3cf2feb", "tag": "85465582-8090-4f05-b0f7-bc4e3bf7fac7"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 10:04:02.623662 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-ad70cafb-8f6c-43a9-9fce-43c69b5f9be5 req-6f991d8b-d582-4d66-b7fb-68abc564b474 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:04:02.624142 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-ad70cafb-8f6c-43a9-9fce-43c69b5f9be5 req-6f991d8b-d582-4d66-b7fb-68abc564b474 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:04:02.624584 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-ad70cafb-8f6c-43a9-9fce-43c69b5f9be5 req-6f991d8b-d582-4d66-b7fb-68abc564b474 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:04:02.636593 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-ad70cafb-8f6c-43a9-9fce-43c69b5f9be5 req-6f991d8b-d582-4d66-b7fb-68abc564b474 service nova] Creating event network-changed:85465582-8090-4f05-b0f7-bc4e3bf7fac7 for instance aafaedae-d0a6-456e-914f-488bd3cf2feb on hv-cinder-79053 Sep 16 10:04:02.641668 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-ad70cafb-8f6c-43a9-9fce-43c69b5f9be5 req-6f991d8b-d582-4d66-b7fb-68abc564b474 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162710 Sep 16 10:04:02.642305 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 594/1186] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 10:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 10:05:56.522579 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 10:05:56.523367 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell1:SELECT=56 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 10:05:56.524597 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 16 10:05:56.524737 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Fri Sep 16 10:05:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/aafaedae-d0a6-456e-914f-488bd3cf2feb (ip 10.222.0.73) !!! Sep 16 10:05:56.526064 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 10:05:56.526180 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Fri Sep 16 10:05:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/aafaedae-d0a6-456e-914f-488bd3cf2feb (ip 10.222.0.73) !!! Sep 16 10:05:56.531591 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-be8d0bc1-7596-48e9-9030-8e457e34016f tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:05:56.539044 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-be8d0bc1-7596-48e9-9030-8e457e34016f tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: aafaedae-d0a6-456e-914f-488bd3cf2feb] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:05:56.539754 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-be8d0bc1-7596-48e9-9030-8e457e34016f tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:05:56.540241 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-be8d0bc1-7596-48e9-9030-8e457e34016f tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:05:56.540674 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-be8d0bc1-7596-48e9-9030-8e457e34016f tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:05:56.541364 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-be8d0bc1-7596-48e9-9030-8e457e34016f tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:05:56.541840 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-be8d0bc1-7596-48e9-9030-8e457e34016f tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:05:56.542273 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-be8d0bc1-7596-48e9-9030-8e457e34016f tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:05:56.571433 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-be8d0bc1-7596-48e9-9030-8e457e34016f tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: aafaedae-d0a6-456e-914f-488bd3cf2feb] Going to try to terminate instance {{(pid=127671) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 10:05:57.009399 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-be8d0bc1-7596-48e9-9030-8e457e34016f tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "DELETE /compute/v2.1/servers/aafaedae-d0a6-456e-914f-488bd3cf2feb" status: 204 len: 0 microversion: 2.1 time: 0.488477 Sep 16 10:05:57.010056 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 593/1187] 10.222.0.73 () {58 vars in 1239 bytes} [Fri Sep 16 10:05:56 2022] DELETE /compute/v2.1/servers/aafaedae-d0a6-456e-914f-488bd3cf2feb => generated 0 bytes in 490 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 10:05:57.017592 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 16 10:05:57.018111 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Fri Sep 16 10:05:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/aafaedae-d0a6-456e-914f-488bd3cf2feb (ip 10.222.0.73) !!! Sep 16 10:05:57.018725 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_api:SELECT=22 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 10:05:57.019452 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=42 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 10:05:57.020462 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 10:05:57.020603 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Fri Sep 16 10:05:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/aafaedae-d0a6-456e-914f-488bd3cf2feb (ip 10.222.0.73) !!! Sep 16 10:05:57.026125 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-285a3e3f-c54c-49c2-9d13-c5f0aa9f4fca tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:05:57.026827 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-285a3e3f-c54c-49c2-9d13-c5f0aa9f4fca tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: aafaedae-d0a6-456e-914f-488bd3cf2feb] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:05:57.035724 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-285a3e3f-c54c-49c2-9d13-c5f0aa9f4fca tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:05:57.036212 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-285a3e3f-c54c-49c2-9d13-c5f0aa9f4fca tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:05:57.036649 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-285a3e3f-c54c-49c2-9d13-c5f0aa9f4fca tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:05:57.037343 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-285a3e3f-c54c-49c2-9d13-c5f0aa9f4fca tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:05:57.037838 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-285a3e3f-c54c-49c2-9d13-c5f0aa9f4fca tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:05:57.038265 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-285a3e3f-c54c-49c2-9d13-c5f0aa9f4fca tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:05:57.232431 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-285a3e3f-c54c-49c2-9d13-c5f0aa9f4fca tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:05:57.240855 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-285a3e3f-c54c-49c2-9d13-c5f0aa9f4fca tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/aafaedae-d0a6-456e-914f-488bd3cf2feb" status: 200 len: 1576 microversion: 2.1 time: 0.226296 Sep 16 10:05:57.241413 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 595/1188] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:05:57 2022] GET /compute/v2.1/servers/aafaedae-d0a6-456e-914f-488bd3cf2feb => generated 1576 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:05:58.267336 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-a0474d9b-7c93-403f-8238-99a5f64c26e0 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:05:58.268047 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-a0474d9b-7c93-403f-8238-99a5f64c26e0 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: aafaedae-d0a6-456e-914f-488bd3cf2feb] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:05:58.274703 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a0474d9b-7c93-403f-8238-99a5f64c26e0 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:05:58.275238 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a0474d9b-7c93-403f-8238-99a5f64c26e0 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:05:58.275685 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a0474d9b-7c93-403f-8238-99a5f64c26e0 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:05:58.276389 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a0474d9b-7c93-403f-8238-99a5f64c26e0 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:05:58.276852 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a0474d9b-7c93-403f-8238-99a5f64c26e0 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:05:58.277286 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a0474d9b-7c93-403f-8238-99a5f64c26e0 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:05:58.477419 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-a0474d9b-7c93-403f-8238-99a5f64c26e0 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:05:58.485300 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-a0474d9b-7c93-403f-8238-99a5f64c26e0 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/aafaedae-d0a6-456e-914f-488bd3cf2feb" status: 200 len: 1576 microversion: 2.1 time: 0.222988 Sep 16 10:05:58.485988 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 594/1189] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:05:58 2022] GET /compute/v2.1/servers/aafaedae-d0a6-456e-914f-488bd3cf2feb => generated 1576 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:05:59.453214 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-da89d00b-8ef8-47e1-97cd-32ea3cf42b39 req-ab59fe50-d9b0-44ea-8075-7f9384a7cf0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aafaedae-d0a6-456e-914f-488bd3cf2feb", "name": "network-vif-deleted", "tag": "85465582-8090-4f05-b0f7-bc4e3bf7fac7"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 10:05:59.463821 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-da89d00b-8ef8-47e1-97cd-32ea3cf42b39 req-ab59fe50-d9b0-44ea-8075-7f9384a7cf0e service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:05:59.468897 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-da89d00b-8ef8-47e1-97cd-32ea3cf42b39 req-ab59fe50-d9b0-44ea-8075-7f9384a7cf0e service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:05:59.468897 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-da89d00b-8ef8-47e1-97cd-32ea3cf42b39 req-ab59fe50-d9b0-44ea-8075-7f9384a7cf0e service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:05:59.477785 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-da89d00b-8ef8-47e1-97cd-32ea3cf42b39 req-ab59fe50-d9b0-44ea-8075-7f9384a7cf0e service nova] Creating event network-vif-deleted:85465582-8090-4f05-b0f7-bc4e3bf7fac7 for instance aafaedae-d0a6-456e-914f-488bd3cf2feb on hv-cinder-79053 Sep 16 10:05:59.483376 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-da89d00b-8ef8-47e1-97cd-32ea3cf42b39 req-ab59fe50-d9b0-44ea-8075-7f9384a7cf0e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035266 Sep 16 10:05:59.484300 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 596/1190] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 10:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 10:05:59.509691 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-daef019d-b942-4021-9ac8-6ef23f7410a7 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:05:59.509691 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-daef019d-b942-4021-9ac8-6ef23f7410a7 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: aafaedae-d0a6-456e-914f-488bd3cf2feb] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:05:59.518485 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-daef019d-b942-4021-9ac8-6ef23f7410a7 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:05:59.519082 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-daef019d-b942-4021-9ac8-6ef23f7410a7 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:05:59.519797 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-daef019d-b942-4021-9ac8-6ef23f7410a7 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:05:59.521492 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-daef019d-b942-4021-9ac8-6ef23f7410a7 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:05:59.521492 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-daef019d-b942-4021-9ac8-6ef23f7410a7 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:05:59.521492 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-daef019d-b942-4021-9ac8-6ef23f7410a7 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:05:59.601242 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-daef019d-b942-4021-9ac8-6ef23f7410a7 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:05:59.609991 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-daef019d-b942-4021-9ac8-6ef23f7410a7 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/aafaedae-d0a6-456e-914f-488bd3cf2feb" status: 200 len: 1509 microversion: 2.1 time: 0.105157 Sep 16 10:05:59.610862 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 595/1191] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:05:59 2022] GET /compute/v2.1/servers/aafaedae-d0a6-456e-914f-488bd3cf2feb => generated 1509 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 10:06:00.635089 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-f0c94f30-e7bf-4d9b-b2dc-8095a873c269 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:06:00.635762 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-f0c94f30-e7bf-4d9b-b2dc-8095a873c269 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: aafaedae-d0a6-456e-914f-488bd3cf2feb] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:06:00.642807 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f0c94f30-e7bf-4d9b-b2dc-8095a873c269 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:06:00.643285 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f0c94f30-e7bf-4d9b-b2dc-8095a873c269 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:06:00.643719 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f0c94f30-e7bf-4d9b-b2dc-8095a873c269 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:06:00.644457 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f0c94f30-e7bf-4d9b-b2dc-8095a873c269 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:06:00.644917 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f0c94f30-e7bf-4d9b-b2dc-8095a873c269 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:06:00.645344 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f0c94f30-e7bf-4d9b-b2dc-8095a873c269 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:06:00.677525 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f0c94f30-e7bf-4d9b-b2dc-8095a873c269 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:06:00.678106 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f0c94f30-e7bf-4d9b-b2dc-8095a873c269 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:06:00.678563 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-f0c94f30-e7bf-4d9b-b2dc-8095a873c269 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:06:00.679068 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.objects.instance [None req-f0c94f30-e7bf-4d9b-b2dc-8095a873c269 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lazy-loading 'fault' on Instance uuid aafaedae-d0a6-456e-914f-488bd3cf2feb {{(pid=127670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 10:06:00.728625 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-f0c94f30-e7bf-4d9b-b2dc-8095a873c269 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:06:00.737203 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-f0c94f30-e7bf-4d9b-b2dc-8095a873c269 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/aafaedae-d0a6-456e-914f-488bd3cf2feb" status: 200 len: 1229 microversion: 2.1 time: 0.106533 Sep 16 10:06:00.737807 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 597/1192] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:06:00 2022] GET /compute/v2.1/servers/aafaedae-d0a6-456e-914f-488bd3cf2feb => generated 1229 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:06:01.761775 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-eb04a1ca-f1c1-4976-91e1-3dc453904a19 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:06:01.762433 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-eb04a1ca-f1c1-4976-91e1-3dc453904a19 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: aafaedae-d0a6-456e-914f-488bd3cf2feb] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:06:01.769446 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-eb04a1ca-f1c1-4976-91e1-3dc453904a19 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:06:01.769988 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-eb04a1ca-f1c1-4976-91e1-3dc453904a19 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:06:01.770424 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-eb04a1ca-f1c1-4976-91e1-3dc453904a19 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:06:01.771123 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-eb04a1ca-f1c1-4976-91e1-3dc453904a19 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:06:01.771799 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-eb04a1ca-f1c1-4976-91e1-3dc453904a19 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:06:01.772229 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-eb04a1ca-f1c1-4976-91e1-3dc453904a19 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:06:01.786716 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.wsgi [None req-eb04a1ca-f1c1-4976-91e1-3dc453904a19 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] HTTP exception thrown: Instance aafaedae-d0a6-456e-914f-488bd3cf2feb could not be found. Sep 16 10:06:01.788761 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-eb04a1ca-f1c1-4976-91e1-3dc453904a19 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Request method failure captured: Sep 16 10:06:01.788761 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: request: GET /compute/v2.1/servers/aafaedae-d0a6-456e-914f-488bd3cf2feb HTTP/1.1 Sep 16 10:06:01.788761 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept: application/json Sep 16 10:06:01.788761 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept-Encoding: identity Sep 16 10:06:01.788761 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Connection: close Sep 16 10:06:01.788761 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Length: 0 Sep 16 10:06:01.788761 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Type: application/json Sep 16 10:06:01.788761 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Host: 10.222.0.73 Sep 16 10:06:01.788761 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Openstack-System-Scope: None Sep 16 10:06:01.788761 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: User-Agent: python-urllib3/1.26.12 Sep 16 10:06:01.788761 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Auth-Token: gAAAAABjJEnidMURbkOXWkOoXCQEVVzN5JJJRyCzqXcYDKZKyLbXnP841EPT257VDd76wG1DoSO3rYQisE-0sb2M3u60F_V7CwM68TYlOJeG2UsQb0-IfVl8n6FZZzzz-XpPC42sn5mvSkfdEluuyoutWKLqeXFrg-kXh0Wd_2HNduxHYhKKEv8 Sep 16 10:06:01.788761 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Id: None Sep 16 10:06:01.788761 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Name: None Sep 16 10:06:01.788761 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Identity-Status: Confirmed Sep 16 10:06:01.788761 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Is-Admin-Project: True Sep 16 10:06:01.788761 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Id: default Sep 16 10:06:01.788761 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Name: Default Sep 16 10:06:01.788761 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Id: aaeb5ec036dd43479e9b66290a29d6d5 Sep 16 10:06:01.788761 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Name: tempest-TestVolumeBootPattern-703768359 Sep 16 10:06:01.788761 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Role: reader,member Sep 16 10:06:01.788761 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Roles: reader,member Sep 16 10:06:01.790653 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/aaeb5ec036dd43479e9b66290a29d6d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_aaeb5ec036dd43479e9b66290a29d6d5", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/aaeb5ec036dd43479e9b66290a29d6d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/aaeb5ec036dd43479e9b66290a29d6d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 10:06:01.790653 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant: tempest-TestVolumeBootPattern-703768359 Sep 16 10:06:01.790653 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Id: aaeb5ec036dd43479e9b66290a29d6d5 Sep 16 10:06:01.790653 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Name: tempest-TestVolumeBootPattern-703768359 Sep 16 10:06:01.790653 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User: tempest-TestVolumeBootPattern-703768359-project Sep 16 10:06:01.790653 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Id: default Sep 16 10:06:01.790653 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Name: Default Sep 16 10:06:01.790653 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Id: f2747c55351847dbb66f29c992dd62aa Sep 16 10:06:01.790653 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Name: tempest-TestVolumeBootPattern-703768359-project Sep 16 10:06:01.790653 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: method: > Sep 16 10:06:01.790653 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: exception: Instance aafaedae-d0a6-456e-914f-488bd3cf2feb could not be found. Sep 16 10:06:01.790653 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: action_args: {'id': 'aafaedae-d0a6-456e-914f-488bd3cf2feb'} Sep 16 10:06:01.791715 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 10:06:01.791715 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 10:06:01.791715 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 10:06:01.791715 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 10:06:01.791715 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 10:06:01.791715 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 10:06:01.791715 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 10:06:01.791715 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 10:06:01.791715 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 10:06:01.791715 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 10:06:01.791715 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aafaedae-d0a6-456e-914f-488bd3cf2feb could not be found. Sep 16 10:06:01.791715 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 10:06:01.791715 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 10:06:01.791715 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 10:06:01.791715 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 10:06:01.791715 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 10:06:01.791715 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 10:06:01.791715 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 10:06:01.791715 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 10:06:01.791715 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 10:06:01.793408 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 10:06:01.793408 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 10:06:01.793408 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 10:06:01.793408 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 10:06:01.793408 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 10:06:01.793408 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 10:06:01.793408 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 10:06:01.793408 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aafaedae-d0a6-456e-914f-488bd3cf2feb could not be found. Sep 16 10:06:01.793408 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 10:06:01.793408 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 10:06:01.793408 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 10:06:01.793408 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 10:06:01.793408 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 10:06:01.793408 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 10:06:01.793408 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 10:06:01.793408 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 10:06:01.793408 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aafaedae-d0a6-456e-914f-488bd3cf2feb could not be found. Sep 16 10:06:01.793408 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 10:06:01.795030 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-eb04a1ca-f1c1-4976-91e1-3dc453904a19 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Returning 404 to user: Instance aafaedae-d0a6-456e-914f-488bd3cf2feb could not be found. {{(pid=127671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 10:06:01.795030 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-eb04a1ca-f1c1-4976-91e1-3dc453904a19 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/aafaedae-d0a6-456e-914f-488bd3cf2feb" status: 404 len: 111 microversion: 2.1 time: 0.032938 Sep 16 10:06:01.795030 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 596/1193] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:06:01 2022] GET /compute/v2.1/servers/aafaedae-d0a6-456e-914f-488bd3cf2feb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 10:06:01.892914 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-109817e7-6fa5-48b5-a755-9e98519a11c3 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-606669704", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-415399696", "security_groups": [{"name": "tempest-secgroup-smoke-283210283"}], "block_device_mapping_v2": [{"uuid": "54c564ee-e938-447a-8ae4-9886f58165b2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "15128754-481d-4580-9909-e9d7f17bf2e9"}]}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 10:06:02.014580 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.network.neutron [None req-109817e7-6fa5-48b5-a755-9e98519a11c3 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] validate_networks() for [('15128754-481d-4580-9909-e9d7f17bf2e9', None, None, None, None, None)] {{(pid=127670) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 10:06:02.462696 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-109817e7-6fa5-48b5-a755-9e98519a11c3 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Flavor limits 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 10:06:02.463191 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-109817e7-6fa5-48b5-a755-9e98519a11c3 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Image limits 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 10:06:02.463671 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-109817e7-6fa5-48b5-a755-9e98519a11c3 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Flavor pref 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 10:06:02.464086 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-109817e7-6fa5-48b5-a755-9e98519a11c3 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Image pref 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 10:06:02.464495 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-109817e7-6fa5-48b5-a755-9e98519a11c3 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 10:06:02.474575 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-109817e7-6fa5-48b5-a755-9e98519a11c3 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:06:02.475055 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-109817e7-6fa5-48b5-a755-9e98519a11c3 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:06:02.475487 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-109817e7-6fa5-48b5-a755-9e98519a11c3 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:06:02.476210 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-109817e7-6fa5-48b5-a755-9e98519a11c3 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:06:02.476660 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-109817e7-6fa5-48b5-a755-9e98519a11c3 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:06:02.477087 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-109817e7-6fa5-48b5-a755-9e98519a11c3 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:06:02.493898 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-109817e7-6fa5-48b5-a755-9e98519a11c3 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Getting quotas for project aaeb5ec036dd43479e9b66290a29d6d5. Resources: {'instances', 'cores', 'ram'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 10:06:02.498319 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-109817e7-6fa5-48b5-a755-9e98519a11c3 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Getting quotas for user f2747c55351847dbb66f29c992dd62aa and project aaeb5ec036dd43479e9b66290a29d6d5. Resources: {'instances', 'cores', 'ram'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 10:06:02.555663 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-109817e7-6fa5-48b5-a755-9e98519a11c3 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Going to run 1 instances... {{(pid=127670) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 10:06:02.557951 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-109817e7-6fa5-48b5-a755-9e98519a11c3 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: 33adb696-c1ac-4c86-94ca-77f76a8f5ea6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='54c564ee-e938-447a-8ae4-9886f58165b2',volume_size=None,volume_type=None)] {{(pid=127670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 10:06:03.080798 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-109817e7-6fa5-48b5-a755-9e98519a11c3 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.192522 Sep 16 10:06:03.082096 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 598/1194] 10.222.0.73 () {60 vars in 1147 bytes} [Fri Sep 16 10:06:01 2022] POST /compute/v2.1/servers => generated 405 bytes in 1194 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 10:06:03.093505 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-eafceab8-dfd8-4f75-bca2-369b927614cb tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:06:03.094150 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-eafceab8-dfd8-4f75-bca2-369b927614cb tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: 33adb696-c1ac-4c86-94ca-77f76a8f5ea6] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:06:03.151437 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-eafceab8-dfd8-4f75-bca2-369b927614cb tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:06:03.158282 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-eafceab8-dfd8-4f75-bca2-369b927614cb tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/33adb696-c1ac-4c86-94ca-77f76a8f5ea6" status: 200 len: 1093 microversion: 2.1 time: 0.068924 Sep 16 10:06:03.158831 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 597/1195] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:06:03 2022] GET /compute/v2.1/servers/33adb696-c1ac-4c86-94ca-77f76a8f5ea6 => generated 1093 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:06:04.182284 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-4db5e4ed-02c5-4a5a-8d65-c8410d542213 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:06:04.182944 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-4db5e4ed-02c5-4a5a-8d65-c8410d542213 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: 33adb696-c1ac-4c86-94ca-77f76a8f5ea6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:06:04.190034 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4db5e4ed-02c5-4a5a-8d65-c8410d542213 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:06:04.198142 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4db5e4ed-02c5-4a5a-8d65-c8410d542213 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:06:04.198142 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4db5e4ed-02c5-4a5a-8d65-c8410d542213 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:06:04.198142 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4db5e4ed-02c5-4a5a-8d65-c8410d542213 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:06:04.198142 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4db5e4ed-02c5-4a5a-8d65-c8410d542213 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:06:04.198682 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-4db5e4ed-02c5-4a5a-8d65-c8410d542213 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:06:04.257906 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-4db5e4ed-02c5-4a5a-8d65-c8410d542213 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:06:04.265559 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-4db5e4ed-02c5-4a5a-8d65-c8410d542213 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/33adb696-c1ac-4c86-94ca-77f76a8f5ea6" status: 200 len: 1143 microversion: 2.1 time: 0.088600 Sep 16 10:06:04.266130 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 599/1196] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:06:04 2022] GET /compute/v2.1/servers/33adb696-c1ac-4c86-94ca-77f76a8f5ea6 => generated 1143 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:06:05.288636 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-076d197f-1f3e-433e-b555-3a726103557f tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:06:05.289246 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-076d197f-1f3e-433e-b555-3a726103557f tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: 33adb696-c1ac-4c86-94ca-77f76a8f5ea6] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:06:05.296375 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-076d197f-1f3e-433e-b555-3a726103557f tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:06:05.296895 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-076d197f-1f3e-433e-b555-3a726103557f tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:06:05.297343 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-076d197f-1f3e-433e-b555-3a726103557f tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:06:05.298166 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-076d197f-1f3e-433e-b555-3a726103557f tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:06:05.298551 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-076d197f-1f3e-433e-b555-3a726103557f tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:06:05.308468 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-076d197f-1f3e-433e-b555-3a726103557f tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:06:05.362228 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-076d197f-1f3e-433e-b555-3a726103557f tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:06:05.372740 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-076d197f-1f3e-433e-b555-3a726103557f tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/33adb696-c1ac-4c86-94ca-77f76a8f5ea6" status: 200 len: 1191 microversion: 2.1 time: 0.088802 Sep 16 10:06:05.373337 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 598/1197] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:06:05 2022] GET /compute/v2.1/servers/33adb696-c1ac-4c86-94ca-77f76a8f5ea6 => generated 1191 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:06:06.395616 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-e5ff84f6-30d8-46a5-b7c2-0b47b54d5daa tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:06:06.398307 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-e5ff84f6-30d8-46a5-b7c2-0b47b54d5daa tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: 33adb696-c1ac-4c86-94ca-77f76a8f5ea6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:06:06.405580 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e5ff84f6-30d8-46a5-b7c2-0b47b54d5daa tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:06:06.406086 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e5ff84f6-30d8-46a5-b7c2-0b47b54d5daa tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:06:06.409199 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e5ff84f6-30d8-46a5-b7c2-0b47b54d5daa tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:06:06.409199 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e5ff84f6-30d8-46a5-b7c2-0b47b54d5daa tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:06:06.409199 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e5ff84f6-30d8-46a5-b7c2-0b47b54d5daa tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:06:06.410708 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e5ff84f6-30d8-46a5-b7c2-0b47b54d5daa tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:06:06.616080 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-e5ff84f6-30d8-46a5-b7c2-0b47b54d5daa tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:06:06.624767 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-e5ff84f6-30d8-46a5-b7c2-0b47b54d5daa tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/33adb696-c1ac-4c86-94ca-77f76a8f5ea6" status: 200 len: 1276 microversion: 2.1 time: 0.233267 Sep 16 10:06:06.625434 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 600/1198] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:06:06 2022] GET /compute/v2.1/servers/33adb696-c1ac-4c86-94ca-77f76a8f5ea6 => generated 1276 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:06:07.469351 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [req-5596d2a9-7ca2-47d6-a906-ec5d2dedf2cc req-206ce2ad-a49f-4d01-84e2-adfd4a978661 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33adb696-c1ac-4c86-94ca-77f76a8f5ea6", "tag": "e715dc1c-a174-44a0-a3f4-3a389b116353"}]} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 10:06:07.481486 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-5596d2a9-7ca2-47d6-a906-ec5d2dedf2cc req-206ce2ad-a49f-4d01-84e2-adfd4a978661 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:06:07.481931 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-5596d2a9-7ca2-47d6-a906-ec5d2dedf2cc req-206ce2ad-a49f-4d01-84e2-adfd4a978661 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:06:07.482400 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-5596d2a9-7ca2-47d6-a906-ec5d2dedf2cc req-206ce2ad-a49f-4d01-84e2-adfd4a978661 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:06:07.497250 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.compute.server_external_events [req-5596d2a9-7ca2-47d6-a906-ec5d2dedf2cc req-206ce2ad-a49f-4d01-84e2-adfd4a978661 service nova] Creating event network-changed:e715dc1c-a174-44a0-a3f4-3a389b116353 for instance 33adb696-c1ac-4c86-94ca-77f76a8f5ea6 on hv-cinder-79053 Sep 16 10:06:07.503144 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [req-5596d2a9-7ca2-47d6-a906-ec5d2dedf2cc req-206ce2ad-a49f-4d01-84e2-adfd4a978661 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037744 Sep 16 10:06:07.503757 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 599/1199] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 10:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 10:06:07.676738 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-aace8ff6-b401-409d-8373-ca85e072bbad tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:06:07.677464 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-aace8ff6-b401-409d-8373-ca85e072bbad tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: 33adb696-c1ac-4c86-94ca-77f76a8f5ea6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:06:07.684253 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-aace8ff6-b401-409d-8373-ca85e072bbad tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:06:07.684922 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-aace8ff6-b401-409d-8373-ca85e072bbad tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:06:07.685440 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-aace8ff6-b401-409d-8373-ca85e072bbad tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:06:07.686394 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-aace8ff6-b401-409d-8373-ca85e072bbad tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:06:07.686926 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-aace8ff6-b401-409d-8373-ca85e072bbad tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:06:07.687354 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-aace8ff6-b401-409d-8373-ca85e072bbad tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:06:07.858627 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-aace8ff6-b401-409d-8373-ca85e072bbad tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:06:07.866478 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-aace8ff6-b401-409d-8373-ca85e072bbad tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/33adb696-c1ac-4c86-94ca-77f76a8f5ea6" status: 200 len: 1264 microversion: 2.1 time: 0.193705 Sep 16 10:06:07.867050 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 601/1200] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:06:07 2022] GET /compute/v2.1/servers/33adb696-c1ac-4c86-94ca-77f76a8f5ea6 => generated 1264 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:06:08.891700 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-92bcb868-51d7-43dc-b3f9-59ae36a24349 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:06:08.893295 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-92bcb868-51d7-43dc-b3f9-59ae36a24349 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: 33adb696-c1ac-4c86-94ca-77f76a8f5ea6] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:06:08.900177 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-92bcb868-51d7-43dc-b3f9-59ae36a24349 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:06:08.900706 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-92bcb868-51d7-43dc-b3f9-59ae36a24349 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:06:08.901123 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-92bcb868-51d7-43dc-b3f9-59ae36a24349 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:06:08.901851 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-92bcb868-51d7-43dc-b3f9-59ae36a24349 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:06:08.902315 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-92bcb868-51d7-43dc-b3f9-59ae36a24349 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:06:08.902736 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-92bcb868-51d7-43dc-b3f9-59ae36a24349 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:06:09.063185 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-92bcb868-51d7-43dc-b3f9-59ae36a24349 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:06:09.071374 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-92bcb868-51d7-43dc-b3f9-59ae36a24349 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/33adb696-c1ac-4c86-94ca-77f76a8f5ea6" status: 200 len: 1264 microversion: 2.1 time: 0.184045 Sep 16 10:06:09.071939 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 600/1201] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:06:08 2022] GET /compute/v2.1/servers/33adb696-c1ac-4c86-94ca-77f76a8f5ea6 => generated 1264 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 10:06:10.094703 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-1ea0402a-f424-4bec-8a6c-7ca5383060d5 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:06:10.095375 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-1ea0402a-f424-4bec-8a6c-7ca5383060d5 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: 33adb696-c1ac-4c86-94ca-77f76a8f5ea6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:06:10.103042 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1ea0402a-f424-4bec-8a6c-7ca5383060d5 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:06:10.103623 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1ea0402a-f424-4bec-8a6c-7ca5383060d5 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:06:10.104105 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1ea0402a-f424-4bec-8a6c-7ca5383060d5 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:06:10.104872 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1ea0402a-f424-4bec-8a6c-7ca5383060d5 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:06:10.105371 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1ea0402a-f424-4bec-8a6c-7ca5383060d5 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:06:10.105839 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-1ea0402a-f424-4bec-8a6c-7ca5383060d5 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:06:10.254123 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-1ea0402a-f424-4bec-8a6c-7ca5383060d5 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:06:10.262093 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-1ea0402a-f424-4bec-8a6c-7ca5383060d5 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/33adb696-c1ac-4c86-94ca-77f76a8f5ea6" status: 200 len: 1264 microversion: 2.1 time: 0.172170 Sep 16 10:06:10.262648 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 602/1202] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:06:10 2022] GET /compute/v2.1/servers/33adb696-c1ac-4c86-94ca-77f76a8f5ea6 => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:06:11.285654 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-9cdc75a1-50fc-4aed-ba90-d3c581540d3d tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:06:11.287717 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-9cdc75a1-50fc-4aed-ba90-d3c581540d3d tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: 33adb696-c1ac-4c86-94ca-77f76a8f5ea6] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:06:11.294844 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9cdc75a1-50fc-4aed-ba90-d3c581540d3d tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:06:11.295437 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9cdc75a1-50fc-4aed-ba90-d3c581540d3d tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:06:11.295991 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9cdc75a1-50fc-4aed-ba90-d3c581540d3d tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:06:11.296719 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9cdc75a1-50fc-4aed-ba90-d3c581540d3d tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:06:11.297181 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9cdc75a1-50fc-4aed-ba90-d3c581540d3d tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:06:11.297677 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-9cdc75a1-50fc-4aed-ba90-d3c581540d3d tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:06:11.437341 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-9cdc75a1-50fc-4aed-ba90-d3c581540d3d tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:06:11.446147 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-9cdc75a1-50fc-4aed-ba90-d3c581540d3d tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/33adb696-c1ac-4c86-94ca-77f76a8f5ea6" status: 200 len: 1264 microversion: 2.1 time: 0.165240 Sep 16 10:06:11.446727 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 601/1203] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:06:11 2022] GET /compute/v2.1/servers/33adb696-c1ac-4c86-94ca-77f76a8f5ea6 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:06:12.471012 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-234b5b24-2fe6-4284-8549-12a381831992 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:06:12.471648 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-234b5b24-2fe6-4284-8549-12a381831992 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: 33adb696-c1ac-4c86-94ca-77f76a8f5ea6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:06:12.480538 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-234b5b24-2fe6-4284-8549-12a381831992 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:06:12.481141 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-234b5b24-2fe6-4284-8549-12a381831992 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:06:12.481652 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-234b5b24-2fe6-4284-8549-12a381831992 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:06:12.482369 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-234b5b24-2fe6-4284-8549-12a381831992 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:06:12.482835 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-234b5b24-2fe6-4284-8549-12a381831992 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:06:12.483271 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-234b5b24-2fe6-4284-8549-12a381831992 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:06:12.486492 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell0:SELECT=2 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 10:06:12.504944 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell0:SELECT=6 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 10:06:12.653063 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-234b5b24-2fe6-4284-8549-12a381831992 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:06:12.662905 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-234b5b24-2fe6-4284-8549-12a381831992 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/33adb696-c1ac-4c86-94ca-77f76a8f5ea6" status: 200 len: 1264 microversion: 2.1 time: 0.196167 Sep 16 10:06:12.663484 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 603/1204] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:06:12 2022] GET /compute/v2.1/servers/33adb696-c1ac-4c86-94ca-77f76a8f5ea6 => generated 1264 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 10:06:13.688683 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-f09620ff-e5b4-4f27-9142-65878ddec153 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:06:13.689516 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-f09620ff-e5b4-4f27-9142-65878ddec153 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: 33adb696-c1ac-4c86-94ca-77f76a8f5ea6] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:06:13.693230 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell0:SELECT=2 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 10:06:13.699957 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f09620ff-e5b4-4f27-9142-65878ddec153 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:06:13.700589 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f09620ff-e5b4-4f27-9142-65878ddec153 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:06:13.701103 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f09620ff-e5b4-4f27-9142-65878ddec153 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:06:13.702049 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f09620ff-e5b4-4f27-9142-65878ddec153 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:06:13.702676 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f09620ff-e5b4-4f27-9142-65878ddec153 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:06:13.703234 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-f09620ff-e5b4-4f27-9142-65878ddec153 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:06:13.855208 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-f09620ff-e5b4-4f27-9142-65878ddec153 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:06:13.863357 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-f09620ff-e5b4-4f27-9142-65878ddec153 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/33adb696-c1ac-4c86-94ca-77f76a8f5ea6" status: 200 len: 1264 microversion: 2.1 time: 0.179705 Sep 16 10:06:13.863930 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 602/1205] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:06:13 2022] GET /compute/v2.1/servers/33adb696-c1ac-4c86-94ca-77f76a8f5ea6 => generated 1264 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:06:14.886316 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d479ec6d-469d-4720-8e6c-d8de7e5d50b8 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:06:14.886970 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-d479ec6d-469d-4720-8e6c-d8de7e5d50b8 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: 33adb696-c1ac-4c86-94ca-77f76a8f5ea6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:06:14.893462 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d479ec6d-469d-4720-8e6c-d8de7e5d50b8 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:06:14.893983 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d479ec6d-469d-4720-8e6c-d8de7e5d50b8 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:06:14.894428 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d479ec6d-469d-4720-8e6c-d8de7e5d50b8 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:06:14.895124 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d479ec6d-469d-4720-8e6c-d8de7e5d50b8 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:06:14.896542 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d479ec6d-469d-4720-8e6c-d8de7e5d50b8 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:06:14.897232 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d479ec6d-469d-4720-8e6c-d8de7e5d50b8 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:06:15.045986 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-d479ec6d-469d-4720-8e6c-d8de7e5d50b8 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:06:15.054001 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-d479ec6d-469d-4720-8e6c-d8de7e5d50b8 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/33adb696-c1ac-4c86-94ca-77f76a8f5ea6" status: 200 len: 1264 microversion: 2.1 time: 0.171507 Sep 16 10:06:15.054578 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 604/1206] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:06:14 2022] GET /compute/v2.1/servers/33adb696-c1ac-4c86-94ca-77f76a8f5ea6 => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:06:16.077019 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-2e14aa5f-d4f3-468c-bfc7-fe17fd0566c2 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:06:16.077666 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-2e14aa5f-d4f3-468c-bfc7-fe17fd0566c2 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: 33adb696-c1ac-4c86-94ca-77f76a8f5ea6] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:06:16.084871 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2e14aa5f-d4f3-468c-bfc7-fe17fd0566c2 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:06:16.085357 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2e14aa5f-d4f3-468c-bfc7-fe17fd0566c2 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:06:16.085829 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2e14aa5f-d4f3-468c-bfc7-fe17fd0566c2 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:06:16.086529 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2e14aa5f-d4f3-468c-bfc7-fe17fd0566c2 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:06:16.087168 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2e14aa5f-d4f3-468c-bfc7-fe17fd0566c2 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:06:16.087418 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2e14aa5f-d4f3-468c-bfc7-fe17fd0566c2 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:06:16.249745 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-2e14aa5f-d4f3-468c-bfc7-fe17fd0566c2 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:06:16.258321 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-2e14aa5f-d4f3-468c-bfc7-fe17fd0566c2 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/33adb696-c1ac-4c86-94ca-77f76a8f5ea6" status: 200 len: 1264 microversion: 2.1 time: 0.185156 Sep 16 10:06:16.258889 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 603/1207] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:06:16 2022] GET /compute/v2.1/servers/33adb696-c1ac-4c86-94ca-77f76a8f5ea6 => generated 1264 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:06:17.287347 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-10e01e6e-8503-48e0-acef-2bf0218ccc1f tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:06:17.288124 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-10e01e6e-8503-48e0-acef-2bf0218ccc1f tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: 33adb696-c1ac-4c86-94ca-77f76a8f5ea6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:06:17.294660 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-10e01e6e-8503-48e0-acef-2bf0218ccc1f tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:06:17.295155 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-10e01e6e-8503-48e0-acef-2bf0218ccc1f tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:06:17.295591 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-10e01e6e-8503-48e0-acef-2bf0218ccc1f tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:06:17.296300 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-10e01e6e-8503-48e0-acef-2bf0218ccc1f tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:06:17.296761 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-10e01e6e-8503-48e0-acef-2bf0218ccc1f tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:06:17.297183 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-10e01e6e-8503-48e0-acef-2bf0218ccc1f tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:06:17.448659 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-10e01e6e-8503-48e0-acef-2bf0218ccc1f tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:06:17.456975 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-10e01e6e-8503-48e0-acef-2bf0218ccc1f tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/33adb696-c1ac-4c86-94ca-77f76a8f5ea6" status: 200 len: 1264 microversion: 2.1 time: 0.173599 Sep 16 10:06:17.457617 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 605/1208] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:06:17 2022] GET /compute/v2.1/servers/33adb696-c1ac-4c86-94ca-77f76a8f5ea6 => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:06:18.480127 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-cb473f41-e2d3-489c-8ac5-f3b8b2530dd9 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:06:18.480817 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-cb473f41-e2d3-489c-8ac5-f3b8b2530dd9 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: 33adb696-c1ac-4c86-94ca-77f76a8f5ea6] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:06:18.488658 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-cb473f41-e2d3-489c-8ac5-f3b8b2530dd9 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:06:18.489154 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-cb473f41-e2d3-489c-8ac5-f3b8b2530dd9 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:06:18.489693 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-cb473f41-e2d3-489c-8ac5-f3b8b2530dd9 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:06:18.490691 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-cb473f41-e2d3-489c-8ac5-f3b8b2530dd9 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:06:18.491162 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-cb473f41-e2d3-489c-8ac5-f3b8b2530dd9 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:06:18.491836 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-cb473f41-e2d3-489c-8ac5-f3b8b2530dd9 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:06:18.548244 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-8455a4e6-b493-4702-8d67-15dd23c3f3b9 req-f306d193-bc6e-44e0-b6f8-da1153818989 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33adb696-c1ac-4c86-94ca-77f76a8f5ea6", "name": "network-vif-plugged", "status": "completed", "tag": "e715dc1c-a174-44a0-a3f4-3a389b116353"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 10:06:18.562480 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-8455a4e6-b493-4702-8d67-15dd23c3f3b9 req-f306d193-bc6e-44e0-b6f8-da1153818989 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:06:18.563081 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-8455a4e6-b493-4702-8d67-15dd23c3f3b9 req-f306d193-bc6e-44e0-b6f8-da1153818989 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:06:18.563641 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-8455a4e6-b493-4702-8d67-15dd23c3f3b9 req-f306d193-bc6e-44e0-b6f8-da1153818989 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:06:18.578876 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-8455a4e6-b493-4702-8d67-15dd23c3f3b9 req-f306d193-bc6e-44e0-b6f8-da1153818989 service nova] Creating event network-vif-plugged:e715dc1c-a174-44a0-a3f4-3a389b116353 for instance 33adb696-c1ac-4c86-94ca-77f76a8f5ea6 on hv-cinder-79053 Sep 16 10:06:18.584391 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-8455a4e6-b493-4702-8d67-15dd23c3f3b9 req-f306d193-bc6e-44e0-b6f8-da1153818989 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040991 Sep 16 10:06:18.584990 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 606/1209] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 10:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 10:06:18.641738 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-cb473f41-e2d3-489c-8ac5-f3b8b2530dd9 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:06:18.649760 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-cb473f41-e2d3-489c-8ac5-f3b8b2530dd9 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/33adb696-c1ac-4c86-94ca-77f76a8f5ea6" status: 200 len: 1264 microversion: 2.1 time: 0.173384 Sep 16 10:06:18.650610 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 604/1210] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:06:18 2022] GET /compute/v2.1/servers/33adb696-c1ac-4c86-94ca-77f76a8f5ea6 => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 10:06:19.674403 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-ce679ef7-d712-4d6c-bf38-977709351ec3 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:06:19.675190 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-ce679ef7-d712-4d6c-bf38-977709351ec3 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: 33adb696-c1ac-4c86-94ca-77f76a8f5ea6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:06:19.684817 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ce679ef7-d712-4d6c-bf38-977709351ec3 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:06:19.685688 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ce679ef7-d712-4d6c-bf38-977709351ec3 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:06:19.686403 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ce679ef7-d712-4d6c-bf38-977709351ec3 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:06:19.687390 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ce679ef7-d712-4d6c-bf38-977709351ec3 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:06:19.687926 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ce679ef7-d712-4d6c-bf38-977709351ec3 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:06:19.688359 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ce679ef7-d712-4d6c-bf38-977709351ec3 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:06:19.824621 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-ce679ef7-d712-4d6c-bf38-977709351ec3 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:06:19.832301 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-ce679ef7-d712-4d6c-bf38-977709351ec3 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/33adb696-c1ac-4c86-94ca-77f76a8f5ea6" status: 200 len: 1264 microversion: 2.1 time: 0.162565 Sep 16 10:06:19.832870 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 607/1211] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:06:19 2022] GET /compute/v2.1/servers/33adb696-c1ac-4c86-94ca-77f76a8f5ea6 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 10:06:20.859402 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-d65f701d-db5d-4ac4-aea0-95ce4b847f22 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:06:20.860022 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-d65f701d-db5d-4ac4-aea0-95ce4b847f22 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: 33adb696-c1ac-4c86-94ca-77f76a8f5ea6] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:06:20.866608 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d65f701d-db5d-4ac4-aea0-95ce4b847f22 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:06:20.867096 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d65f701d-db5d-4ac4-aea0-95ce4b847f22 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:06:20.867537 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d65f701d-db5d-4ac4-aea0-95ce4b847f22 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:06:20.868353 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d65f701d-db5d-4ac4-aea0-95ce4b847f22 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:06:20.868812 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d65f701d-db5d-4ac4-aea0-95ce4b847f22 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:06:20.869238 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-d65f701d-db5d-4ac4-aea0-95ce4b847f22 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:06:21.027097 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-d65f701d-db5d-4ac4-aea0-95ce4b847f22 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:06:21.034920 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-d65f701d-db5d-4ac4-aea0-95ce4b847f22 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/33adb696-c1ac-4c86-94ca-77f76a8f5ea6" status: 200 len: 1452 microversion: 2.1 time: 0.179444 Sep 16 10:06:21.035563 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 605/1212] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:06:20 2022] GET /compute/v2.1/servers/33adb696-c1ac-4c86-94ca-77f76a8f5ea6 => generated 1452 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:06:21.065965 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-ed8cbb9c-58b7-4489-8b5a-1c267f497734 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:06:21.066647 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-ed8cbb9c-58b7-4489-8b5a-1c267f497734 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: 33adb696-c1ac-4c86-94ca-77f76a8f5ea6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:06:21.073394 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ed8cbb9c-58b7-4489-8b5a-1c267f497734 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:06:21.073895 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ed8cbb9c-58b7-4489-8b5a-1c267f497734 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:06:21.074331 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ed8cbb9c-58b7-4489-8b5a-1c267f497734 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:06:21.075025 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ed8cbb9c-58b7-4489-8b5a-1c267f497734 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:06:21.075480 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ed8cbb9c-58b7-4489-8b5a-1c267f497734 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:06:21.075904 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ed8cbb9c-58b7-4489-8b5a-1c267f497734 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:06:21.223412 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-ed8cbb9c-58b7-4489-8b5a-1c267f497734 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:06:21.231986 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-ed8cbb9c-58b7-4489-8b5a-1c267f497734 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/33adb696-c1ac-4c86-94ca-77f76a8f5ea6" status: 200 len: 1452 microversion: 2.1 time: 0.169978 Sep 16 10:06:21.232549 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 608/1213] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:06:21 2022] GET /compute/v2.1/servers/33adb696-c1ac-4c86-94ca-77f76a8f5ea6 => generated 1452 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:06:23.311250 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [req-b7aa867a-ccb1-4e17-a9e1-a1f1829187ec req-0d813e6e-49af-496a-9007-eb90de36c032 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33adb696-c1ac-4c86-94ca-77f76a8f5ea6", "tag": "e715dc1c-a174-44a0-a3f4-3a389b116353"}]} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 10:06:23.322655 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-b7aa867a-ccb1-4e17-a9e1-a1f1829187ec req-0d813e6e-49af-496a-9007-eb90de36c032 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:06:23.323237 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-b7aa867a-ccb1-4e17-a9e1-a1f1829187ec req-0d813e6e-49af-496a-9007-eb90de36c032 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:06:23.323743 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-b7aa867a-ccb1-4e17-a9e1-a1f1829187ec req-0d813e6e-49af-496a-9007-eb90de36c032 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:06:23.336580 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.compute.server_external_events [req-b7aa867a-ccb1-4e17-a9e1-a1f1829187ec req-0d813e6e-49af-496a-9007-eb90de36c032 service nova] Creating event network-changed:e715dc1c-a174-44a0-a3f4-3a389b116353 for instance 33adb696-c1ac-4c86-94ca-77f76a8f5ea6 on hv-cinder-79053 Sep 16 10:06:23.342102 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [req-b7aa867a-ccb1-4e17-a9e1-a1f1829187ec req-0d813e6e-49af-496a-9007-eb90de36c032 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034543 Sep 16 10:06:23.342826 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 606/1214] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 10:06:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 10:07:58.588706 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 10:07:58.589504 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=74 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 10:07:58.595047 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-fee2266b-fa36-48ab-b6a2-a47bfe1bd891 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1331468030", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-415399696", "security_groups": [{"name": "tempest-secgroup-smoke-283210283"}], "block_device_mapping_v2": [{"uuid": "7f8cb597-6fab-4158-b77a-970340e1a1ab", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "15128754-481d-4580-9909-e9d7f17bf2e9"}]}} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 10:07:58.716444 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.network.neutron [None req-fee2266b-fa36-48ab-b6a2-a47bfe1bd891 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] validate_networks() for [('15128754-481d-4580-9909-e9d7f17bf2e9', None, None, None, None, None)] {{(pid=127670) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 10:07:59.145768 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-fee2266b-fa36-48ab-b6a2-a47bfe1bd891 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Flavor limits 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 10:07:59.146210 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-fee2266b-fa36-48ab-b6a2-a47bfe1bd891 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Image limits 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 10:07:59.146690 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-fee2266b-fa36-48ab-b6a2-a47bfe1bd891 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Flavor pref 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 10:07:59.147170 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-fee2266b-fa36-48ab-b6a2-a47bfe1bd891 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Image pref 0:0:0 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 10:07:59.147589 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.virt.hardware [None req-fee2266b-fa36-48ab-b6a2-a47bfe1bd891 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 10:07:59.161354 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fee2266b-fa36-48ab-b6a2-a47bfe1bd891 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:07:59.161887 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fee2266b-fa36-48ab-b6a2-a47bfe1bd891 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:07:59.162332 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fee2266b-fa36-48ab-b6a2-a47bfe1bd891 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:07:59.163068 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fee2266b-fa36-48ab-b6a2-a47bfe1bd891 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:07:59.163535 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fee2266b-fa36-48ab-b6a2-a47bfe1bd891 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:07:59.163962 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-fee2266b-fa36-48ab-b6a2-a47bfe1bd891 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:07:59.183714 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-fee2266b-fa36-48ab-b6a2-a47bfe1bd891 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Getting quotas for project aaeb5ec036dd43479e9b66290a29d6d5. Resources: {'instances', 'cores', 'ram'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 10:07:59.189289 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.quota [None req-fee2266b-fa36-48ab-b6a2-a47bfe1bd891 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Getting quotas for user f2747c55351847dbb66f29c992dd62aa and project aaeb5ec036dd43479e9b66290a29d6d5. Resources: {'instances', 'cores', 'ram'} {{(pid=127670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 10:07:59.259906 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-fee2266b-fa36-48ab-b6a2-a47bfe1bd891 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Going to run 1 instances... {{(pid=127670) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 10:07:59.262132 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-fee2266b-fa36-48ab-b6a2-a47bfe1bd891 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: 8e45bd2b-3420-4322-934e-e55031e42e0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7f8cb597-6fab-4158-b77a-970340e1a1ab',volume_size=None,volume_type=None)] {{(pid=127670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 10:07:59.706900 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-fee2266b-fa36-48ab-b6a2-a47bfe1bd891 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.120233 Sep 16 10:07:59.707607 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 609/1215] 10.222.0.73 () {60 vars in 1147 bytes} [Fri Sep 16 10:07:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 1122 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 10:07:59.725374 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 10:07:59.726255 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 10:07:59.727163 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 10:07:59.727303 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Fri Sep 16 10:07:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8e45bd2b-3420-4322-934e-e55031e42e0d (ip 10.222.0.73) !!! Sep 16 10:07:59.733934 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-04cacb81-bc32-4c4d-b125-989d1767ad04 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:07:59.741161 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-04cacb81-bc32-4c4d-b125-989d1767ad04 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: 8e45bd2b-3420-4322-934e-e55031e42e0d] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:07:59.801034 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-04cacb81-bc32-4c4d-b125-989d1767ad04 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:07:59.808545 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-04cacb81-bc32-4c4d-b125-989d1767ad04 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/8e45bd2b-3420-4322-934e-e55031e42e0d" status: 200 len: 1094 microversion: 2.1 time: 0.085296 Sep 16 10:07:59.817598 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 607/1216] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:07:59 2022] GET /compute/v2.1/servers/8e45bd2b-3420-4322-934e-e55031e42e0d => generated 1094 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:08:00.833841 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-eab63bd4-1e12-4d06-9bcf-1f79e1e296b0 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:08:00.834559 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-eab63bd4-1e12-4d06-9bcf-1f79e1e296b0 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: 8e45bd2b-3420-4322-934e-e55031e42e0d] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:08:00.890474 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-eab63bd4-1e12-4d06-9bcf-1f79e1e296b0 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:08:00.898087 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-eab63bd4-1e12-4d06-9bcf-1f79e1e296b0 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/8e45bd2b-3420-4322-934e-e55031e42e0d" status: 200 len: 1094 microversion: 2.1 time: 0.068635 Sep 16 10:08:00.906327 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 610/1217] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:08:00 2022] GET /compute/v2.1/servers/8e45bd2b-3420-4322-934e-e55031e42e0d => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:08:01.925111 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-0d816034-5098-4f70-896e-402538d58cc6 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:08:01.925770 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-0d816034-5098-4f70-896e-402538d58cc6 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: 8e45bd2b-3420-4322-934e-e55031e42e0d] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:08:01.933174 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-0d816034-5098-4f70-896e-402538d58cc6 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:08:01.933696 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-0d816034-5098-4f70-896e-402538d58cc6 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:08:01.934134 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-0d816034-5098-4f70-896e-402538d58cc6 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:08:01.934852 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-0d816034-5098-4f70-896e-402538d58cc6 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:08:01.935316 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-0d816034-5098-4f70-896e-402538d58cc6 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:08:01.935738 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-0d816034-5098-4f70-896e-402538d58cc6 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:08:02.002019 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-0d816034-5098-4f70-896e-402538d58cc6 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:08:02.011031 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-0d816034-5098-4f70-896e-402538d58cc6 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/8e45bd2b-3420-4322-934e-e55031e42e0d" status: 200 len: 1144 microversion: 2.1 time: 0.091124 Sep 16 10:08:02.011612 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 608/1218] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:08:01 2022] GET /compute/v2.1/servers/8e45bd2b-3420-4322-934e-e55031e42e0d => generated 1144 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:08:03.035671 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-88ade15b-44dc-4509-8837-4cab080853f3 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:08:03.036224 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-88ade15b-44dc-4509-8837-4cab080853f3 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: 8e45bd2b-3420-4322-934e-e55031e42e0d] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:08:03.042410 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-88ade15b-44dc-4509-8837-4cab080853f3 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:08:03.042904 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-88ade15b-44dc-4509-8837-4cab080853f3 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:08:03.043350 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-88ade15b-44dc-4509-8837-4cab080853f3 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:08:03.044052 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-88ade15b-44dc-4509-8837-4cab080853f3 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:08:03.044516 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-88ade15b-44dc-4509-8837-4cab080853f3 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:08:03.044948 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-88ade15b-44dc-4509-8837-4cab080853f3 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:08:03.110501 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-88ade15b-44dc-4509-8837-4cab080853f3 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:08:03.118611 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-88ade15b-44dc-4509-8837-4cab080853f3 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/8e45bd2b-3420-4322-934e-e55031e42e0d" status: 200 len: 1192 microversion: 2.1 time: 0.087513 Sep 16 10:08:03.119199 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 611/1219] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:08:03 2022] GET /compute/v2.1/servers/8e45bd2b-3420-4322-934e-e55031e42e0d => generated 1192 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:08:04.156921 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-73a46077-85ed-46d2-a5bd-09d17b1ccdf6 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:08:04.156921 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-73a46077-85ed-46d2-a5bd-09d17b1ccdf6 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: 8e45bd2b-3420-4322-934e-e55031e42e0d] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:08:04.160163 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-73a46077-85ed-46d2-a5bd-09d17b1ccdf6 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:08:04.160728 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-73a46077-85ed-46d2-a5bd-09d17b1ccdf6 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:08:04.161174 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-73a46077-85ed-46d2-a5bd-09d17b1ccdf6 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:08:04.161921 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-73a46077-85ed-46d2-a5bd-09d17b1ccdf6 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:08:04.162381 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-73a46077-85ed-46d2-a5bd-09d17b1ccdf6 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:08:04.162817 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-73a46077-85ed-46d2-a5bd-09d17b1ccdf6 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:08:04.312172 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-73a46077-85ed-46d2-a5bd-09d17b1ccdf6 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:08:04.322002 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-73a46077-85ed-46d2-a5bd-09d17b1ccdf6 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/8e45bd2b-3420-4322-934e-e55031e42e0d" status: 200 len: 1277 microversion: 2.1 time: 0.172603 Sep 16 10:08:04.322002 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 609/1220] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:08:04 2022] GET /compute/v2.1/servers/8e45bd2b-3420-4322-934e-e55031e42e0d => generated 1277 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:08:05.067974 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-878515ac-4782-4086-8e2b-63a4925655bc req-f86367b3-2c4d-4d9f-b99b-6bd4a1cf9413 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e45bd2b-3420-4322-934e-e55031e42e0d", "tag": "3d8e53fa-cbf5-4fc1-8350-b26e2d8e4d58"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 10:08:05.077699 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-878515ac-4782-4086-8e2b-63a4925655bc req-f86367b3-2c4d-4d9f-b99b-6bd4a1cf9413 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:08:05.078191 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-878515ac-4782-4086-8e2b-63a4925655bc req-f86367b3-2c4d-4d9f-b99b-6bd4a1cf9413 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:08:05.078631 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-878515ac-4782-4086-8e2b-63a4925655bc req-f86367b3-2c4d-4d9f-b99b-6bd4a1cf9413 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:08:05.090425 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-878515ac-4782-4086-8e2b-63a4925655bc req-f86367b3-2c4d-4d9f-b99b-6bd4a1cf9413 service nova] Creating event network-changed:3d8e53fa-cbf5-4fc1-8350-b26e2d8e4d58 for instance 8e45bd2b-3420-4322-934e-e55031e42e0d on hv-cinder-79053 Sep 16 10:08:05.095692 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-878515ac-4782-4086-8e2b-63a4925655bc req-f86367b3-2c4d-4d9f-b99b-6bd4a1cf9413 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092761 Sep 16 10:08:05.096292 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 612/1221] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 10:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 10:08:05.345810 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-c1455584-b283-4a42-88c4-98632d027ddf tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:08:05.346459 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-c1455584-b283-4a42-88c4-98632d027ddf tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: 8e45bd2b-3420-4322-934e-e55031e42e0d] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:08:05.352920 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c1455584-b283-4a42-88c4-98632d027ddf tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:08:05.353417 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c1455584-b283-4a42-88c4-98632d027ddf tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:08:05.353890 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c1455584-b283-4a42-88c4-98632d027ddf tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:08:05.354624 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c1455584-b283-4a42-88c4-98632d027ddf tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:08:05.355084 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c1455584-b283-4a42-88c4-98632d027ddf tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:08:05.355513 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c1455584-b283-4a42-88c4-98632d027ddf tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:08:05.501225 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-c1455584-b283-4a42-88c4-98632d027ddf tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:08:05.510526 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-c1455584-b283-4a42-88c4-98632d027ddf tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/8e45bd2b-3420-4322-934e-e55031e42e0d" status: 200 len: 1265 microversion: 2.1 time: 0.169594 Sep 16 10:08:05.511132 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 610/1222] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:08:05 2022] GET /compute/v2.1/servers/8e45bd2b-3420-4322-934e-e55031e42e0d => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:08:06.535893 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-d3be0371-4f48-42be-900c-8e832481fc30 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:08:06.536603 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-d3be0371-4f48-42be-900c-8e832481fc30 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: 8e45bd2b-3420-4322-934e-e55031e42e0d] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:08:06.543453 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d3be0371-4f48-42be-900c-8e832481fc30 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:08:06.543953 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d3be0371-4f48-42be-900c-8e832481fc30 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:08:06.544420 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d3be0371-4f48-42be-900c-8e832481fc30 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:08:06.545131 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d3be0371-4f48-42be-900c-8e832481fc30 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:08:06.545658 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d3be0371-4f48-42be-900c-8e832481fc30 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:08:06.546092 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-d3be0371-4f48-42be-900c-8e832481fc30 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:08:06.703855 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-d3be0371-4f48-42be-900c-8e832481fc30 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:08:06.711287 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-d3be0371-4f48-42be-900c-8e832481fc30 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/8e45bd2b-3420-4322-934e-e55031e42e0d" status: 200 len: 1265 microversion: 2.1 time: 0.180141 Sep 16 10:08:06.711868 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 613/1223] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:08:06 2022] GET /compute/v2.1/servers/8e45bd2b-3420-4322-934e-e55031e42e0d => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:08:07.734649 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-c2d7a898-8ce2-4463-8ceb-2b5dd1767270 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:08:07.735206 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-c2d7a898-8ce2-4463-8ceb-2b5dd1767270 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: 8e45bd2b-3420-4322-934e-e55031e42e0d] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:08:07.741849 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c2d7a898-8ce2-4463-8ceb-2b5dd1767270 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:08:07.742362 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c2d7a898-8ce2-4463-8ceb-2b5dd1767270 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:08:07.742813 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c2d7a898-8ce2-4463-8ceb-2b5dd1767270 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:08:07.743522 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c2d7a898-8ce2-4463-8ceb-2b5dd1767270 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:08:07.743981 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c2d7a898-8ce2-4463-8ceb-2b5dd1767270 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:08:07.744411 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c2d7a898-8ce2-4463-8ceb-2b5dd1767270 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:08:07.882700 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-c2d7a898-8ce2-4463-8ceb-2b5dd1767270 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:08:07.891754 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-c2d7a898-8ce2-4463-8ceb-2b5dd1767270 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/8e45bd2b-3420-4322-934e-e55031e42e0d" status: 200 len: 1265 microversion: 2.1 time: 0.161761 Sep 16 10:08:07.892328 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 611/1224] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:08:07 2022] GET /compute/v2.1/servers/8e45bd2b-3420-4322-934e-e55031e42e0d => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:08:08.914904 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-485aed61-e08b-47ca-87af-9cc3f159b6ea tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:08:08.915802 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-485aed61-e08b-47ca-87af-9cc3f159b6ea tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: 8e45bd2b-3420-4322-934e-e55031e42e0d] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:08:08.923004 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-485aed61-e08b-47ca-87af-9cc3f159b6ea tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:08:08.923503 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-485aed61-e08b-47ca-87af-9cc3f159b6ea tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:08:08.923948 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-485aed61-e08b-47ca-87af-9cc3f159b6ea tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:08:08.924658 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-485aed61-e08b-47ca-87af-9cc3f159b6ea tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:08:08.925116 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-485aed61-e08b-47ca-87af-9cc3f159b6ea tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:08:08.925846 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-485aed61-e08b-47ca-87af-9cc3f159b6ea tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:08:09.069279 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-485aed61-e08b-47ca-87af-9cc3f159b6ea tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:08:09.077442 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-485aed61-e08b-47ca-87af-9cc3f159b6ea tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/8e45bd2b-3420-4322-934e-e55031e42e0d" status: 200 len: 1265 microversion: 2.1 time: 0.166435 Sep 16 10:08:09.078181 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 614/1225] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:08:08 2022] GET /compute/v2.1/servers/8e45bd2b-3420-4322-934e-e55031e42e0d => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:08:10.102213 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-60ad8bad-309e-441c-87f5-a46ff86e5b1c tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:08:10.102833 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-60ad8bad-309e-441c-87f5-a46ff86e5b1c tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: 8e45bd2b-3420-4322-934e-e55031e42e0d] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:08:10.105207 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell0:SELECT=2 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 10:08:10.111235 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-60ad8bad-309e-441c-87f5-a46ff86e5b1c tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:08:10.111726 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-60ad8bad-309e-441c-87f5-a46ff86e5b1c tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:08:10.112171 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-60ad8bad-309e-441c-87f5-a46ff86e5b1c tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:08:10.112872 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-60ad8bad-309e-441c-87f5-a46ff86e5b1c tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:08:10.113328 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-60ad8bad-309e-441c-87f5-a46ff86e5b1c tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:08:10.113778 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-60ad8bad-309e-441c-87f5-a46ff86e5b1c tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:08:10.246008 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-60ad8bad-309e-441c-87f5-a46ff86e5b1c tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:08:10.254923 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-60ad8bad-309e-441c-87f5-a46ff86e5b1c tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/8e45bd2b-3420-4322-934e-e55031e42e0d" status: 200 len: 1265 microversion: 2.1 time: 0.156551 Sep 16 10:08:10.257528 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 612/1226] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:08:10 2022] GET /compute/v2.1/servers/8e45bd2b-3420-4322-934e-e55031e42e0d => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:08:11.279069 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-a4520c82-2638-48d5-9f4b-c7359480d67e tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:08:11.281014 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-a4520c82-2638-48d5-9f4b-c7359480d67e tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: 8e45bd2b-3420-4322-934e-e55031e42e0d] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:08:11.283941 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell0:SELECT=2 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 10:08:11.286020 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell0:SELECT=8 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 10:08:11.290392 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a4520c82-2638-48d5-9f4b-c7359480d67e tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:08:11.299546 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a4520c82-2638-48d5-9f4b-c7359480d67e tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:08:11.299546 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a4520c82-2638-48d5-9f4b-c7359480d67e tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:08:11.299546 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a4520c82-2638-48d5-9f4b-c7359480d67e tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:08:11.299546 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a4520c82-2638-48d5-9f4b-c7359480d67e tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:08:11.301103 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a4520c82-2638-48d5-9f4b-c7359480d67e tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:08:11.447859 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-a4520c82-2638-48d5-9f4b-c7359480d67e tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:08:11.456098 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-a4520c82-2638-48d5-9f4b-c7359480d67e tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/8e45bd2b-3420-4322-934e-e55031e42e0d" status: 200 len: 1265 microversion: 2.1 time: 0.181122 Sep 16 10:08:11.456714 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 615/1227] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:08:11 2022] GET /compute/v2.1/servers/8e45bd2b-3420-4322-934e-e55031e42e0d => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:08:12.479961 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-cc1e55b3-d29b-434d-bc64-aef881d97a37 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:08:12.480563 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-cc1e55b3-d29b-434d-bc64-aef881d97a37 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: 8e45bd2b-3420-4322-934e-e55031e42e0d] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:08:12.487765 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-cc1e55b3-d29b-434d-bc64-aef881d97a37 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:08:12.488253 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-cc1e55b3-d29b-434d-bc64-aef881d97a37 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:08:12.488691 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-cc1e55b3-d29b-434d-bc64-aef881d97a37 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:08:12.489505 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-cc1e55b3-d29b-434d-bc64-aef881d97a37 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:08:12.489879 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-cc1e55b3-d29b-434d-bc64-aef881d97a37 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:08:12.490309 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-cc1e55b3-d29b-434d-bc64-aef881d97a37 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:08:12.634272 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-cc1e55b3-d29b-434d-bc64-aef881d97a37 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:08:12.642195 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-cc1e55b3-d29b-434d-bc64-aef881d97a37 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/8e45bd2b-3420-4322-934e-e55031e42e0d" status: 200 len: 1265 microversion: 2.1 time: 0.166182 Sep 16 10:08:12.642776 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 613/1228] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:08:12 2022] GET /compute/v2.1/servers/8e45bd2b-3420-4322-934e-e55031e42e0d => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 10:08:13.665417 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-ed402efe-a05a-4a45-b24c-e83563234dd8 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:08:13.666154 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-ed402efe-a05a-4a45-b24c-e83563234dd8 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: 8e45bd2b-3420-4322-934e-e55031e42e0d] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:08:13.673475 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ed402efe-a05a-4a45-b24c-e83563234dd8 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:08:13.676737 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ed402efe-a05a-4a45-b24c-e83563234dd8 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:08:13.677681 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ed402efe-a05a-4a45-b24c-e83563234dd8 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:08:13.678434 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ed402efe-a05a-4a45-b24c-e83563234dd8 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:08:13.678904 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ed402efe-a05a-4a45-b24c-e83563234dd8 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:08:13.679400 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-ed402efe-a05a-4a45-b24c-e83563234dd8 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:08:13.814162 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-ed402efe-a05a-4a45-b24c-e83563234dd8 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:08:13.821877 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-ed402efe-a05a-4a45-b24c-e83563234dd8 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/8e45bd2b-3420-4322-934e-e55031e42e0d" status: 200 len: 1265 microversion: 2.1 time: 0.160356 Sep 16 10:08:13.822454 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 616/1229] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:08:13 2022] GET /compute/v2.1/servers/8e45bd2b-3420-4322-934e-e55031e42e0d => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:08:14.844818 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-a22f7bd9-c35d-4cc9-a14d-27899777011c tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:08:14.845773 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-a22f7bd9-c35d-4cc9-a14d-27899777011c tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: 8e45bd2b-3420-4322-934e-e55031e42e0d] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:08:14.852485 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a22f7bd9-c35d-4cc9-a14d-27899777011c tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:08:14.852971 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a22f7bd9-c35d-4cc9-a14d-27899777011c tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:08:14.853415 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a22f7bd9-c35d-4cc9-a14d-27899777011c tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:08:14.854141 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a22f7bd9-c35d-4cc9-a14d-27899777011c tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:08:14.854603 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a22f7bd9-c35d-4cc9-a14d-27899777011c tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:08:14.855177 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-a22f7bd9-c35d-4cc9-a14d-27899777011c tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:08:14.992916 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-a22f7bd9-c35d-4cc9-a14d-27899777011c tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:08:15.002134 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-a22f7bd9-c35d-4cc9-a14d-27899777011c tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/8e45bd2b-3420-4322-934e-e55031e42e0d" status: 200 len: 1265 microversion: 2.1 time: 0.160974 Sep 16 10:08:15.003136 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 614/1230] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:08:14 2022] GET /compute/v2.1/servers/8e45bd2b-3420-4322-934e-e55031e42e0d => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:08:15.308210 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-25e22719-283c-4606-a4ef-9c7d3f18f2db req-a2b001e9-5b0e-4684-9ead-994e02a01038 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e45bd2b-3420-4322-934e-e55031e42e0d", "name": "network-vif-plugged", "status": "completed", "tag": "3d8e53fa-cbf5-4fc1-8350-b26e2d8e4d58"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 10:08:15.317846 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-25e22719-283c-4606-a4ef-9c7d3f18f2db req-a2b001e9-5b0e-4684-9ead-994e02a01038 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:08:15.318323 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-25e22719-283c-4606-a4ef-9c7d3f18f2db req-a2b001e9-5b0e-4684-9ead-994e02a01038 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:08:15.318748 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-25e22719-283c-4606-a4ef-9c7d3f18f2db req-a2b001e9-5b0e-4684-9ead-994e02a01038 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:08:15.329449 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-25e22719-283c-4606-a4ef-9c7d3f18f2db req-a2b001e9-5b0e-4684-9ead-994e02a01038 service nova] Creating event network-vif-plugged:3d8e53fa-cbf5-4fc1-8350-b26e2d8e4d58 for instance 8e45bd2b-3420-4322-934e-e55031e42e0d on hv-cinder-79053 Sep 16 10:08:15.335177 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-25e22719-283c-4606-a4ef-9c7d3f18f2db req-a2b001e9-5b0e-4684-9ead-994e02a01038 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087233 Sep 16 10:08:15.335761 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 617/1231] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 10:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 10:08:16.024595 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-58bf9c5f-76d0-41a8-8e97-9f6d326dace7 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:08:16.025148 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-58bf9c5f-76d0-41a8-8e97-9f6d326dace7 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: 8e45bd2b-3420-4322-934e-e55031e42e0d] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:08:16.031577 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-58bf9c5f-76d0-41a8-8e97-9f6d326dace7 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:08:16.032054 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-58bf9c5f-76d0-41a8-8e97-9f6d326dace7 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:08:16.032491 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-58bf9c5f-76d0-41a8-8e97-9f6d326dace7 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:08:16.033816 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-58bf9c5f-76d0-41a8-8e97-9f6d326dace7 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:08:16.034273 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-58bf9c5f-76d0-41a8-8e97-9f6d326dace7 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:08:16.034694 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-58bf9c5f-76d0-41a8-8e97-9f6d326dace7 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:08:16.165335 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-58bf9c5f-76d0-41a8-8e97-9f6d326dace7 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:08:16.173230 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-58bf9c5f-76d0-41a8-8e97-9f6d326dace7 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/8e45bd2b-3420-4322-934e-e55031e42e0d" status: 200 len: 1265 microversion: 2.1 time: 0.152652 Sep 16 10:08:16.174116 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 615/1232] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:08:16 2022] GET /compute/v2.1/servers/8e45bd2b-3420-4322-934e-e55031e42e0d => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:08:17.196429 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-766fb4af-e6df-4c54-9318-996a3397c7d4 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:08:17.197124 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-766fb4af-e6df-4c54-9318-996a3397c7d4 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: 8e45bd2b-3420-4322-934e-e55031e42e0d] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:08:17.203280 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-766fb4af-e6df-4c54-9318-996a3397c7d4 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:08:17.203762 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-766fb4af-e6df-4c54-9318-996a3397c7d4 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:08:17.204200 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-766fb4af-e6df-4c54-9318-996a3397c7d4 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:08:17.204915 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-766fb4af-e6df-4c54-9318-996a3397c7d4 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:08:17.205476 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-766fb4af-e6df-4c54-9318-996a3397c7d4 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:08:17.206060 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-766fb4af-e6df-4c54-9318-996a3397c7d4 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:08:17.343196 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-766fb4af-e6df-4c54-9318-996a3397c7d4 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:08:17.351644 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-766fb4af-e6df-4c54-9318-996a3397c7d4 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/8e45bd2b-3420-4322-934e-e55031e42e0d" status: 200 len: 1453 microversion: 2.1 time: 0.159797 Sep 16 10:08:17.352254 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 618/1233] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:08:17 2022] GET /compute/v2.1/servers/8e45bd2b-3420-4322-934e-e55031e42e0d => generated 1453 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:08:17.407414 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-92bc053a-fd9a-4ebf-9101-8439df8c6b65 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:08:17.408107 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-92bc053a-fd9a-4ebf-9101-8439df8c6b65 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: 8e45bd2b-3420-4322-934e-e55031e42e0d] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:08:17.415294 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-92bc053a-fd9a-4ebf-9101-8439df8c6b65 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:08:17.415773 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-92bc053a-fd9a-4ebf-9101-8439df8c6b65 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:08:17.416205 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-92bc053a-fd9a-4ebf-9101-8439df8c6b65 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:08:17.416894 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-92bc053a-fd9a-4ebf-9101-8439df8c6b65 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:08:17.417343 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-92bc053a-fd9a-4ebf-9101-8439df8c6b65 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:08:17.417801 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-92bc053a-fd9a-4ebf-9101-8439df8c6b65 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:08:17.558142 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-92bc053a-fd9a-4ebf-9101-8439df8c6b65 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:08:17.565965 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-92bc053a-fd9a-4ebf-9101-8439df8c6b65 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/8e45bd2b-3420-4322-934e-e55031e42e0d" status: 200 len: 1453 microversion: 2.1 time: 0.162370 Sep 16 10:08:17.566538 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 616/1234] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:08:17 2022] GET /compute/v2.1/servers/8e45bd2b-3420-4322-934e-e55031e42e0d => generated 1453 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:08:19.865810 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-a315913f-2332-4105-b69b-ac72148bfee3 req-8f61bd65-3051-4e6a-8d2f-0a12a6aa039c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e45bd2b-3420-4322-934e-e55031e42e0d", "tag": "3d8e53fa-cbf5-4fc1-8350-b26e2d8e4d58"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 10:08:19.875653 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-a315913f-2332-4105-b69b-ac72148bfee3 req-8f61bd65-3051-4e6a-8d2f-0a12a6aa039c service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:08:19.876124 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-a315913f-2332-4105-b69b-ac72148bfee3 req-8f61bd65-3051-4e6a-8d2f-0a12a6aa039c service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:08:19.876582 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-a315913f-2332-4105-b69b-ac72148bfee3 req-8f61bd65-3051-4e6a-8d2f-0a12a6aa039c service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:08:19.887535 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-a315913f-2332-4105-b69b-ac72148bfee3 req-8f61bd65-3051-4e6a-8d2f-0a12a6aa039c service nova] Creating event network-changed:3d8e53fa-cbf5-4fc1-8350-b26e2d8e4d58 for instance 8e45bd2b-3420-4322-934e-e55031e42e0d on hv-cinder-79053 Sep 16 10:08:19.892590 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-a315913f-2332-4105-b69b-ac72148bfee3 req-8f61bd65-3051-4e6a-8d2f-0a12a6aa039c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030650 Sep 16 10:08:19.893810 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 619/1235] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 10:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 10:09:52.345445 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_api:SELECT=22 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 10:09:52.346303 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG dbcounter [-] [127671] Writing DB stats nova_cell1:SELECT=54 {{(pid=127671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 10:09:52.347598 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 10:09:52.347756 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Fri Sep 16 10:09:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8e45bd2b-3420-4322-934e-e55031e42e0d (ip 10.222.0.73) !!! Sep 16 10:09:52.348786 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 10:09:52.349079 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Fri Sep 16 10:09:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8e45bd2b-3420-4322-934e-e55031e42e0d (ip 10.222.0.73) !!! Sep 16 10:09:52.351034 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 10:09:52.359431 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG dbcounter [-] [127670] Writing DB stats nova_cell1:SELECT=44 {{(pid=127670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 10:09:52.359431 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 10:09:52.359431 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Fri Sep 16 10:09:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.73) !!! Sep 16 10:09:52.359744 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-98fc2e4a-3e47-43ab-82f6-1f25fd3a380b tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:09:52.359744 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-98fc2e4a-3e47-43ab-82f6-1f25fd3a380b tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: 8e45bd2b-3420-4322-934e-e55031e42e0d] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:09:52.359920 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [req-a9c0b46d-a58d-4dcf-8613-bc1a5aed6e10 req-86f7825b-0f72-4b53-a26c-10119aea4d37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e45bd2b-3420-4322-934e-e55031e42e0d", "tag": "3d8e53fa-cbf5-4fc1-8350-b26e2d8e4d58"}]} {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 10:09:52.372830 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-a9c0b46d-a58d-4dcf-8613-bc1a5aed6e10 req-86f7825b-0f72-4b53-a26c-10119aea4d37 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:09:52.373185 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-98fc2e4a-3e47-43ab-82f6-1f25fd3a380b tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:09:52.373473 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-98fc2e4a-3e47-43ab-82f6-1f25fd3a380b tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:09:52.373981 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-98fc2e4a-3e47-43ab-82f6-1f25fd3a380b tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:09:52.374410 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-a9c0b46d-a58d-4dcf-8613-bc1a5aed6e10 req-86f7825b-0f72-4b53-a26c-10119aea4d37 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:09:52.375039 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [req-a9c0b46d-a58d-4dcf-8613-bc1a5aed6e10 req-86f7825b-0f72-4b53-a26c-10119aea4d37 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:09:52.375485 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-98fc2e4a-3e47-43ab-82f6-1f25fd3a380b tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:09:52.376018 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-98fc2e4a-3e47-43ab-82f6-1f25fd3a380b tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:09:52.376636 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-98fc2e4a-3e47-43ab-82f6-1f25fd3a380b tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:09:52.390749 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.compute.server_external_events [req-a9c0b46d-a58d-4dcf-8613-bc1a5aed6e10 req-86f7825b-0f72-4b53-a26c-10119aea4d37 service nova] Creating event network-changed:3d8e53fa-cbf5-4fc1-8350-b26e2d8e4d58 for instance 8e45bd2b-3420-4322-934e-e55031e42e0d on hv-cinder-79053 Sep 16 10:09:52.396784 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [req-a9c0b46d-a58d-4dcf-8613-bc1a5aed6e10 req-86f7825b-0f72-4b53-a26c-10119aea4d37 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048572 Sep 16 10:09:52.398068 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 620/1236] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 10:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 10:09:52.410768 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-98fc2e4a-3e47-43ab-82f6-1f25fd3a380b tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: 8e45bd2b-3420-4322-934e-e55031e42e0d] Going to try to terminate instance {{(pid=127671) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 10:09:52.706458 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-98fc2e4a-3e47-43ab-82f6-1f25fd3a380b tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "DELETE /compute/v2.1/servers/8e45bd2b-3420-4322-934e-e55031e42e0d" status: 204 len: 0 microversion: 2.1 time: 0.362714 Sep 16 10:09:52.707425 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 617/1237] 10.222.0.73 () {58 vars in 1239 bytes} [Fri Sep 16 10:09:52 2022] DELETE /compute/v2.1/servers/8e45bd2b-3420-4322-934e-e55031e42e0d => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 16 10:09:52.717707 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-a7ac7312-96c9-4a7e-bde7-13c26fa8ff00 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:09:52.718430 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-a7ac7312-96c9-4a7e-bde7-13c26fa8ff00 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: 8e45bd2b-3420-4322-934e-e55031e42e0d] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:09:52.725484 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a7ac7312-96c9-4a7e-bde7-13c26fa8ff00 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:09:52.725997 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a7ac7312-96c9-4a7e-bde7-13c26fa8ff00 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:09:52.726438 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a7ac7312-96c9-4a7e-bde7-13c26fa8ff00 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:09:52.727147 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a7ac7312-96c9-4a7e-bde7-13c26fa8ff00 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:09:52.727605 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a7ac7312-96c9-4a7e-bde7-13c26fa8ff00 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:09:52.728031 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-a7ac7312-96c9-4a7e-bde7-13c26fa8ff00 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:09:52.866847 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-a7ac7312-96c9-4a7e-bde7-13c26fa8ff00 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:09:52.875598 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-a7ac7312-96c9-4a7e-bde7-13c26fa8ff00 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/8e45bd2b-3420-4322-934e-e55031e42e0d" status: 200 len: 1459 microversion: 2.1 time: 0.163598 Sep 16 10:09:52.876210 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 621/1238] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:09:52 2022] GET /compute/v2.1/servers/8e45bd2b-3420-4322-934e-e55031e42e0d => generated 1459 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:09:53.906715 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-eb3b254d-e7d1-44f7-b619-9cbc29aebdfc tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:09:53.907764 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-eb3b254d-e7d1-44f7-b619-9cbc29aebdfc tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: 8e45bd2b-3420-4322-934e-e55031e42e0d] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:09:53.919328 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-eb3b254d-e7d1-44f7-b619-9cbc29aebdfc tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:09:53.925031 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-eb3b254d-e7d1-44f7-b619-9cbc29aebdfc tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:09:53.925031 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-eb3b254d-e7d1-44f7-b619-9cbc29aebdfc tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:09:53.925031 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-eb3b254d-e7d1-44f7-b619-9cbc29aebdfc tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:09:53.925031 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-eb3b254d-e7d1-44f7-b619-9cbc29aebdfc tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:09:53.925734 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-eb3b254d-e7d1-44f7-b619-9cbc29aebdfc tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:09:54.084261 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-eb3b254d-e7d1-44f7-b619-9cbc29aebdfc tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:09:54.095869 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-eb3b254d-e7d1-44f7-b619-9cbc29aebdfc tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/8e45bd2b-3420-4322-934e-e55031e42e0d" status: 200 len: 1459 microversion: 2.1 time: 0.197504 Sep 16 10:09:54.097032 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 618/1239] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:09:53 2022] GET /compute/v2.1/servers/8e45bd2b-3420-4322-934e-e55031e42e0d => generated 1459 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:09:55.120820 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-e60495d4-6909-4b03-b250-357f2ca32b48 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:09:55.121432 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-e60495d4-6909-4b03-b250-357f2ca32b48 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: 8e45bd2b-3420-4322-934e-e55031e42e0d] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:09:55.128868 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e60495d4-6909-4b03-b250-357f2ca32b48 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:09:55.129364 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e60495d4-6909-4b03-b250-357f2ca32b48 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:09:55.129840 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e60495d4-6909-4b03-b250-357f2ca32b48 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:09:55.130548 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e60495d4-6909-4b03-b250-357f2ca32b48 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:09:55.131008 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e60495d4-6909-4b03-b250-357f2ca32b48 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:09:55.131487 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-e60495d4-6909-4b03-b250-357f2ca32b48 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:09:55.289906 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-e60495d4-6909-4b03-b250-357f2ca32b48 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:09:55.307654 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-e60495d4-6909-4b03-b250-357f2ca32b48 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/8e45bd2b-3420-4322-934e-e55031e42e0d" status: 200 len: 1459 microversion: 2.1 time: 0.181079 Sep 16 10:09:55.307654 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 622/1240] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:09:55 2022] GET /compute/v2.1/servers/8e45bd2b-3420-4322-934e-e55031e42e0d => generated 1459 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:09:55.453203 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [req-11db424a-afb2-48a1-ac94-d99e2bcb01d1 req-f9b751a1-f898-4323-8ddb-bde99328f45b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e45bd2b-3420-4322-934e-e55031e42e0d", "name": "network-vif-deleted", "tag": "3d8e53fa-cbf5-4fc1-8350-b26e2d8e4d58"}]} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 10:09:55.464530 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-11db424a-afb2-48a1-ac94-d99e2bcb01d1 req-f9b751a1-f898-4323-8ddb-bde99328f45b service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:09:55.470595 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-11db424a-afb2-48a1-ac94-d99e2bcb01d1 req-f9b751a1-f898-4323-8ddb-bde99328f45b service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:09:55.470595 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-11db424a-afb2-48a1-ac94-d99e2bcb01d1 req-f9b751a1-f898-4323-8ddb-bde99328f45b service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:09:55.480409 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.compute.server_external_events [req-11db424a-afb2-48a1-ac94-d99e2bcb01d1 req-f9b751a1-f898-4323-8ddb-bde99328f45b service nova] Creating event network-vif-deleted:3d8e53fa-cbf5-4fc1-8350-b26e2d8e4d58 for instance 8e45bd2b-3420-4322-934e-e55031e42e0d on hv-cinder-79053 Sep 16 10:09:55.486078 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [req-11db424a-afb2-48a1-ac94-d99e2bcb01d1 req-f9b751a1-f898-4323-8ddb-bde99328f45b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040774 Sep 16 10:09:55.486688 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 619/1241] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 10:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 10:09:56.333896 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-c04faf7c-4876-403c-baae-c01a271e1b60 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:09:56.334502 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-c04faf7c-4876-403c-baae-c01a271e1b60 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: 8e45bd2b-3420-4322-934e-e55031e42e0d] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:09:56.342356 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c04faf7c-4876-403c-baae-c01a271e1b60 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:09:56.342862 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c04faf7c-4876-403c-baae-c01a271e1b60 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:09:56.343298 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c04faf7c-4876-403c-baae-c01a271e1b60 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:09:56.343998 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c04faf7c-4876-403c-baae-c01a271e1b60 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:09:56.344452 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c04faf7c-4876-403c-baae-c01a271e1b60 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:09:56.344873 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c04faf7c-4876-403c-baae-c01a271e1b60 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:09:56.377052 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c04faf7c-4876-403c-baae-c01a271e1b60 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:09:56.377675 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c04faf7c-4876-403c-baae-c01a271e1b60 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:09:56.378169 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-c04faf7c-4876-403c-baae-c01a271e1b60 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:09:56.378617 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.objects.instance [None req-c04faf7c-4876-403c-baae-c01a271e1b60 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lazy-loading 'fault' on Instance uuid 8e45bd2b-3420-4322-934e-e55031e42e0d {{(pid=127670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 10:09:56.423156 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-c04faf7c-4876-403c-baae-c01a271e1b60 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:09:56.431010 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-c04faf7c-4876-403c-baae-c01a271e1b60 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/8e45bd2b-3420-4322-934e-e55031e42e0d" status: 200 len: 1230 microversion: 2.1 time: 0.101136 Sep 16 10:09:56.431572 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 623/1242] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:09:56 2022] GET /compute/v2.1/servers/8e45bd2b-3420-4322-934e-e55031e42e0d => generated 1230 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:09:57.457208 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-c7c81fe8-d55f-41a9-b20c-f3dfd4a76ddb tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:09:57.458010 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-c7c81fe8-d55f-41a9-b20c-f3dfd4a76ddb tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: 8e45bd2b-3420-4322-934e-e55031e42e0d] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:09:57.464953 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c7c81fe8-d55f-41a9-b20c-f3dfd4a76ddb tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:09:57.465492 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c7c81fe8-d55f-41a9-b20c-f3dfd4a76ddb tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:09:57.468378 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c7c81fe8-d55f-41a9-b20c-f3dfd4a76ddb tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:09:57.468378 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c7c81fe8-d55f-41a9-b20c-f3dfd4a76ddb tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:09:57.468378 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c7c81fe8-d55f-41a9-b20c-f3dfd4a76ddb tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:09:57.468882 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-c7c81fe8-d55f-41a9-b20c-f3dfd4a76ddb tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:09:57.483886 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.wsgi [None req-c7c81fe8-d55f-41a9-b20c-f3dfd4a76ddb tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] HTTP exception thrown: Instance 8e45bd2b-3420-4322-934e-e55031e42e0d could not be found. Sep 16 10:09:57.485627 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-c7c81fe8-d55f-41a9-b20c-f3dfd4a76ddb tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Request method failure captured: Sep 16 10:09:57.485627 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: request: GET /compute/v2.1/servers/8e45bd2b-3420-4322-934e-e55031e42e0d HTTP/1.1 Sep 16 10:09:57.485627 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept: application/json Sep 16 10:09:57.485627 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept-Encoding: identity Sep 16 10:09:57.485627 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Connection: close Sep 16 10:09:57.485627 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Length: 0 Sep 16 10:09:57.485627 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Type: application/json Sep 16 10:09:57.485627 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Host: 10.222.0.73 Sep 16 10:09:57.485627 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Openstack-System-Scope: None Sep 16 10:09:57.485627 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: User-Agent: python-urllib3/1.26.12 Sep 16 10:09:57.485627 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Auth-Token: gAAAAABjJEnidMURbkOXWkOoXCQEVVzN5JJJRyCzqXcYDKZKyLbXnP841EPT257VDd76wG1DoSO3rYQisE-0sb2M3u60F_V7CwM68TYlOJeG2UsQb0-IfVl8n6FZZzzz-XpPC42sn5mvSkfdEluuyoutWKLqeXFrg-kXh0Wd_2HNduxHYhKKEv8 Sep 16 10:09:57.485627 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Id: None Sep 16 10:09:57.485627 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Name: None Sep 16 10:09:57.485627 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Identity-Status: Confirmed Sep 16 10:09:57.485627 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Is-Admin-Project: True Sep 16 10:09:57.485627 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Id: default Sep 16 10:09:57.485627 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Name: Default Sep 16 10:09:57.485627 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Id: aaeb5ec036dd43479e9b66290a29d6d5 Sep 16 10:09:57.485627 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Name: tempest-TestVolumeBootPattern-703768359 Sep 16 10:09:57.485627 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Role: reader,member Sep 16 10:09:57.485627 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Roles: reader,member Sep 16 10:09:57.487598 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/aaeb5ec036dd43479e9b66290a29d6d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_aaeb5ec036dd43479e9b66290a29d6d5", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/aaeb5ec036dd43479e9b66290a29d6d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/aaeb5ec036dd43479e9b66290a29d6d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 10:09:57.487598 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant: tempest-TestVolumeBootPattern-703768359 Sep 16 10:09:57.487598 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Id: aaeb5ec036dd43479e9b66290a29d6d5 Sep 16 10:09:57.487598 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Name: tempest-TestVolumeBootPattern-703768359 Sep 16 10:09:57.487598 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User: tempest-TestVolumeBootPattern-703768359-project Sep 16 10:09:57.487598 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Id: default Sep 16 10:09:57.487598 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Name: Default Sep 16 10:09:57.487598 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Id: f2747c55351847dbb66f29c992dd62aa Sep 16 10:09:57.487598 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Name: tempest-TestVolumeBootPattern-703768359-project Sep 16 10:09:57.487598 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: method: > Sep 16 10:09:57.487598 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: exception: Instance 8e45bd2b-3420-4322-934e-e55031e42e0d could not be found. Sep 16 10:09:57.487598 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: action_args: {'id': '8e45bd2b-3420-4322-934e-e55031e42e0d'} Sep 16 10:09:57.488613 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 10:09:57.488613 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 10:09:57.488613 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 10:09:57.488613 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 10:09:57.488613 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 10:09:57.488613 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 10:09:57.488613 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 10:09:57.488613 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 10:09:57.488613 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 10:09:57.488613 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 10:09:57.488613 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e45bd2b-3420-4322-934e-e55031e42e0d could not be found. Sep 16 10:09:57.488613 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 10:09:57.488613 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 10:09:57.488613 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 10:09:57.488613 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 10:09:57.488613 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 10:09:57.488613 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 10:09:57.488613 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 10:09:57.488613 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 10:09:57.488613 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 10:09:57.490678 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 10:09:57.490678 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 10:09:57.490678 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 10:09:57.490678 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 10:09:57.490678 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 10:09:57.490678 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 10:09:57.490678 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 10:09:57.490678 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e45bd2b-3420-4322-934e-e55031e42e0d could not be found. Sep 16 10:09:57.490678 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 10:09:57.490678 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 10:09:57.490678 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 10:09:57.490678 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 10:09:57.490678 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 10:09:57.490678 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 10:09:57.490678 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 10:09:57.490678 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 10:09:57.490678 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e45bd2b-3420-4322-934e-e55031e42e0d could not be found. Sep 16 10:09:57.490678 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 10:09:57.492288 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-c7c81fe8-d55f-41a9-b20c-f3dfd4a76ddb tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Returning 404 to user: Instance 8e45bd2b-3420-4322-934e-e55031e42e0d could not be found. {{(pid=127671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 10:09:57.492288 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-c7c81fe8-d55f-41a9-b20c-f3dfd4a76ddb tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/8e45bd2b-3420-4322-934e-e55031e42e0d" status: 404 len: 111 microversion: 2.1 time: 0.034770 Sep 16 10:09:57.492288 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 620/1243] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:09:57 2022] GET /compute/v2.1/servers/8e45bd2b-3420-4322-934e-e55031e42e0d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 10:10:00.959715 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-36f12371-5ffe-4ca8-944c-969abe01a0ab tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:10:00.960899 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-36f12371-5ffe-4ca8-944c-969abe01a0ab tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: 33adb696-c1ac-4c86-94ca-77f76a8f5ea6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:10:00.969734 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-36f12371-5ffe-4ca8-944c-969abe01a0ab tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:10:00.971280 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-36f12371-5ffe-4ca8-944c-969abe01a0ab tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:10:00.971280 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-36f12371-5ffe-4ca8-944c-969abe01a0ab tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:10:00.971840 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-36f12371-5ffe-4ca8-944c-969abe01a0ab tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:10:00.972557 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-36f12371-5ffe-4ca8-944c-969abe01a0ab tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:10:00.973066 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-36f12371-5ffe-4ca8-944c-969abe01a0ab tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:10:01.004413 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-36f12371-5ffe-4ca8-944c-969abe01a0ab tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: 33adb696-c1ac-4c86-94ca-77f76a8f5ea6] Going to try to terminate instance {{(pid=127670) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 10:10:01.071657 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [req-5a6bd85b-a561-4318-a3b2-a1b0c78f9253 req-8168ceff-61b9-4596-8e0f-a3bf5eca3eec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33adb696-c1ac-4c86-94ca-77f76a8f5ea6", "tag": "e715dc1c-a174-44a0-a3f4-3a389b116353"}]} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 10:10:01.081917 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-5a6bd85b-a561-4318-a3b2-a1b0c78f9253 req-8168ceff-61b9-4596-8e0f-a3bf5eca3eec service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:10:01.082704 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-5a6bd85b-a561-4318-a3b2-a1b0c78f9253 req-8168ceff-61b9-4596-8e0f-a3bf5eca3eec service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:10:01.083183 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-5a6bd85b-a561-4318-a3b2-a1b0c78f9253 req-8168ceff-61b9-4596-8e0f-a3bf5eca3eec service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:10:01.096258 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.compute.server_external_events [req-5a6bd85b-a561-4318-a3b2-a1b0c78f9253 req-8168ceff-61b9-4596-8e0f-a3bf5eca3eec service nova] Creating event network-changed:e715dc1c-a174-44a0-a3f4-3a389b116353 for instance 33adb696-c1ac-4c86-94ca-77f76a8f5ea6 on hv-cinder-79053 Sep 16 10:10:01.102605 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [req-5a6bd85b-a561-4318-a3b2-a1b0c78f9253 req-8168ceff-61b9-4596-8e0f-a3bf5eca3eec service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145134 Sep 16 10:10:01.106222 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 621/1244] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 10:10:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 10:10:01.364847 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-36f12371-5ffe-4ca8-944c-969abe01a0ab tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "DELETE /compute/v2.1/servers/33adb696-c1ac-4c86-94ca-77f76a8f5ea6" status: 204 len: 0 microversion: 2.1 time: 0.407604 Sep 16 10:10:01.365893 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 624/1245] 10.222.0.73 () {58 vars in 1239 bytes} [Fri Sep 16 10:10:00 2022] DELETE /compute/v2.1/servers/33adb696-c1ac-4c86-94ca-77f76a8f5ea6 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 10:10:01.376207 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-1f9c3898-2246-47c8-a810-269c95962263 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:10:01.376977 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-1f9c3898-2246-47c8-a810-269c95962263 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: 33adb696-c1ac-4c86-94ca-77f76a8f5ea6] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:10:01.387402 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1f9c3898-2246-47c8-a810-269c95962263 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:10:01.387881 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1f9c3898-2246-47c8-a810-269c95962263 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:10:01.390660 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1f9c3898-2246-47c8-a810-269c95962263 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:10:01.392143 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1f9c3898-2246-47c8-a810-269c95962263 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:10:01.393095 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1f9c3898-2246-47c8-a810-269c95962263 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:10:01.394042 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-1f9c3898-2246-47c8-a810-269c95962263 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:10:01.589878 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.policy [None req-1f9c3898-2246-47c8-a810-269c95962263 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127671) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:10:01.599006 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-1f9c3898-2246-47c8-a810-269c95962263 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/33adb696-c1ac-4c86-94ca-77f76a8f5ea6" status: 200 len: 1577 microversion: 2.1 time: 0.227796 Sep 16 10:10:01.599575 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 622/1246] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:10:01 2022] GET /compute/v2.1/servers/33adb696-c1ac-4c86-94ca-77f76a8f5ea6 => generated 1577 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:10:02.624457 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-aa483c70-c389-4253-9f42-992c8e623d9a tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:10:02.625198 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-aa483c70-c389-4253-9f42-992c8e623d9a tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: 33adb696-c1ac-4c86-94ca-77f76a8f5ea6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:10:02.631576 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-aa483c70-c389-4253-9f42-992c8e623d9a tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:10:02.632098 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-aa483c70-c389-4253-9f42-992c8e623d9a tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:10:02.632567 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-aa483c70-c389-4253-9f42-992c8e623d9a tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:10:02.633272 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-aa483c70-c389-4253-9f42-992c8e623d9a tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:10:02.633762 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-aa483c70-c389-4253-9f42-992c8e623d9a tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:10:02.634194 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-aa483c70-c389-4253-9f42-992c8e623d9a tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:10:02.774724 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-aa483c70-c389-4253-9f42-992c8e623d9a tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:10:02.783630 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-aa483c70-c389-4253-9f42-992c8e623d9a tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/33adb696-c1ac-4c86-94ca-77f76a8f5ea6" status: 200 len: 1577 microversion: 2.1 time: 0.164125 Sep 16 10:10:02.784235 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 625/1247] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:10:02 2022] GET /compute/v2.1/servers/33adb696-c1ac-4c86-94ca-77f76a8f5ea6 => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:10:03.364936 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [req-2b63aa7e-db73-45df-aafe-c0802319ba0c req-e4fa7b6c-6d8a-47e3-b4a5-bf0bc51140e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33adb696-c1ac-4c86-94ca-77f76a8f5ea6", "name": "network-vif-deleted", "tag": "e715dc1c-a174-44a0-a3f4-3a389b116353"}]} {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 10:10:03.376217 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-2b63aa7e-db73-45df-aafe-c0802319ba0c req-e4fa7b6c-6d8a-47e3-b4a5-bf0bc51140e8 service nova] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:10:03.376705 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-2b63aa7e-db73-45df-aafe-c0802319ba0c req-e4fa7b6c-6d8a-47e3-b4a5-bf0bc51140e8 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:10:03.377141 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [req-2b63aa7e-db73-45df-aafe-c0802319ba0c req-e4fa7b6c-6d8a-47e3-b4a5-bf0bc51140e8 service nova] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:10:03.389085 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.compute.server_external_events [req-2b63aa7e-db73-45df-aafe-c0802319ba0c req-e4fa7b6c-6d8a-47e3-b4a5-bf0bc51140e8 service nova] Creating event network-vif-deleted:e715dc1c-a174-44a0-a3f4-3a389b116353 for instance 33adb696-c1ac-4c86-94ca-77f76a8f5ea6 on hv-cinder-79053 Sep 16 10:10:03.394053 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [req-2b63aa7e-db73-45df-aafe-c0802319ba0c req-e4fa7b6c-6d8a-47e3-b4a5-bf0bc51140e8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035456 Sep 16 10:10:03.394657 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 623/1248] 10.222.0.73 () {64 vars in 1317 bytes} [Fri Sep 16 10:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 10:10:03.808889 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-32617bcc-9bf1-48b1-8d83-c4001693712c tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:10:03.809515 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-32617bcc-9bf1-48b1-8d83-c4001693712c tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: 33adb696-c1ac-4c86-94ca-77f76a8f5ea6] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:10:03.816570 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-32617bcc-9bf1-48b1-8d83-c4001693712c tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:10:03.817070 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-32617bcc-9bf1-48b1-8d83-c4001693712c tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:10:03.817512 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-32617bcc-9bf1-48b1-8d83-c4001693712c tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:10:03.818297 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-32617bcc-9bf1-48b1-8d83-c4001693712c tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:10:03.818754 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-32617bcc-9bf1-48b1-8d83-c4001693712c tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:10:03.819225 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-32617bcc-9bf1-48b1-8d83-c4001693712c tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:10:03.884229 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.policy [None req-32617bcc-9bf1-48b1-8d83-c4001693712c tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2747c55351847dbb66f29c992dd62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeb5ec036dd43479e9b66290a29d6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127670) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 10:10:03.892842 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-32617bcc-9bf1-48b1-8d83-c4001693712c tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/33adb696-c1ac-4c86-94ca-77f76a8f5ea6" status: 200 len: 1224 microversion: 2.1 time: 0.088399 Sep 16 10:10:03.893417 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 626/1249] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:10:03 2022] GET /compute/v2.1/servers/33adb696-c1ac-4c86-94ca-77f76a8f5ea6 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 10:10:04.918043 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-2427cc53-21fb-421c-a594-7dd003d0d8ab tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:10:04.918672 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-2427cc53-21fb-421c-a594-7dd003d0d8ab tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: 33adb696-c1ac-4c86-94ca-77f76a8f5ea6] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:10:04.925616 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2427cc53-21fb-421c-a594-7dd003d0d8ab tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:10:04.926102 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2427cc53-21fb-421c-a594-7dd003d0d8ab tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:10:04.926541 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2427cc53-21fb-421c-a594-7dd003d0d8ab tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:10:04.927294 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2427cc53-21fb-421c-a594-7dd003d0d8ab tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:10:04.927770 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2427cc53-21fb-421c-a594-7dd003d0d8ab tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:10:04.928195 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-2427cc53-21fb-421c-a594-7dd003d0d8ab tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:10:04.942168 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.wsgi [None req-2427cc53-21fb-421c-a594-7dd003d0d8ab tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] HTTP exception thrown: Instance 33adb696-c1ac-4c86-94ca-77f76a8f5ea6 could not be found. Sep 16 10:10:04.943792 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-2427cc53-21fb-421c-a594-7dd003d0d8ab tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Request method failure captured: Sep 16 10:10:04.943792 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: request: GET /compute/v2.1/servers/33adb696-c1ac-4c86-94ca-77f76a8f5ea6 HTTP/1.1 Sep 16 10:10:04.943792 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept: application/json Sep 16 10:10:04.943792 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept-Encoding: identity Sep 16 10:10:04.943792 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Connection: close Sep 16 10:10:04.943792 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Length: 0 Sep 16 10:10:04.943792 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Type: application/json Sep 16 10:10:04.943792 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Host: 10.222.0.73 Sep 16 10:10:04.943792 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Openstack-System-Scope: None Sep 16 10:10:04.943792 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: User-Agent: python-urllib3/1.26.12 Sep 16 10:10:04.943792 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Auth-Token: gAAAAABjJEnidMURbkOXWkOoXCQEVVzN5JJJRyCzqXcYDKZKyLbXnP841EPT257VDd76wG1DoSO3rYQisE-0sb2M3u60F_V7CwM68TYlOJeG2UsQb0-IfVl8n6FZZzzz-XpPC42sn5mvSkfdEluuyoutWKLqeXFrg-kXh0Wd_2HNduxHYhKKEv8 Sep 16 10:10:04.943792 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Id: None Sep 16 10:10:04.943792 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Name: None Sep 16 10:10:04.943792 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Identity-Status: Confirmed Sep 16 10:10:04.943792 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Is-Admin-Project: True Sep 16 10:10:04.943792 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Id: default Sep 16 10:10:04.943792 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Name: Default Sep 16 10:10:04.943792 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Id: aaeb5ec036dd43479e9b66290a29d6d5 Sep 16 10:10:04.943792 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Name: tempest-TestVolumeBootPattern-703768359 Sep 16 10:10:04.943792 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Role: reader,member Sep 16 10:10:04.943792 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Roles: reader,member Sep 16 10:10:04.945471 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/aaeb5ec036dd43479e9b66290a29d6d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_aaeb5ec036dd43479e9b66290a29d6d5", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/aaeb5ec036dd43479e9b66290a29d6d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/aaeb5ec036dd43479e9b66290a29d6d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 10:10:04.945471 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant: tempest-TestVolumeBootPattern-703768359 Sep 16 10:10:04.945471 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Id: aaeb5ec036dd43479e9b66290a29d6d5 Sep 16 10:10:04.945471 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Name: tempest-TestVolumeBootPattern-703768359 Sep 16 10:10:04.945471 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User: tempest-TestVolumeBootPattern-703768359-project Sep 16 10:10:04.945471 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Id: default Sep 16 10:10:04.945471 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Name: Default Sep 16 10:10:04.945471 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Id: f2747c55351847dbb66f29c992dd62aa Sep 16 10:10:04.945471 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Name: tempest-TestVolumeBootPattern-703768359-project Sep 16 10:10:04.945471 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: method: > Sep 16 10:10:04.945471 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: exception: Instance 33adb696-c1ac-4c86-94ca-77f76a8f5ea6 could not be found. Sep 16 10:10:04.945471 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: action_args: {'id': '33adb696-c1ac-4c86-94ca-77f76a8f5ea6'} Sep 16 10:10:04.946451 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 10:10:04.946451 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 10:10:04.946451 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 10:10:04.946451 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 10:10:04.946451 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 10:10:04.946451 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 10:10:04.946451 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 10:10:04.946451 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 10:10:04.946451 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 10:10:04.946451 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 10:10:04.946451 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33adb696-c1ac-4c86-94ca-77f76a8f5ea6 could not be found. Sep 16 10:10:04.946451 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 10:10:04.946451 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 10:10:04.946451 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 10:10:04.946451 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 10:10:04.946451 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 10:10:04.946451 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 10:10:04.946451 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 10:10:04.946451 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 10:10:04.946451 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 10:10:04.948133 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 10:10:04.948133 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 10:10:04.948133 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 10:10:04.948133 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 10:10:04.948133 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 10:10:04.948133 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 10:10:04.948133 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 10:10:04.948133 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33adb696-c1ac-4c86-94ca-77f76a8f5ea6 could not be found. Sep 16 10:10:04.948133 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 10:10:04.948133 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 10:10:04.948133 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 10:10:04.948133 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 10:10:04.948133 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 10:10:04.948133 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 10:10:04.948133 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 10:10:04.948133 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 10:10:04.948133 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33adb696-c1ac-4c86-94ca-77f76a8f5ea6 could not be found. Sep 16 10:10:04.948133 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 10:10:04.949586 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-2427cc53-21fb-421c-a594-7dd003d0d8ab tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Returning 404 to user: Instance 33adb696-c1ac-4c86-94ca-77f76a8f5ea6 could not be found. {{(pid=127671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 10:10:04.949586 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-2427cc53-21fb-421c-a594-7dd003d0d8ab tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/33adb696-c1ac-4c86-94ca-77f76a8f5ea6" status: 404 len: 111 microversion: 2.1 time: 0.032332 Sep 16 10:10:04.949586 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 624/1250] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:10:04 2022] GET /compute/v2.1/servers/33adb696-c1ac-4c86-94ca-77f76a8f5ea6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 10:10:05.514451 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-6e3697e0-f48e-44a2-930a-82e277040839 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:10:05.514451 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.compute.api [None req-6e3697e0-f48e-44a2-930a-82e277040839 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: aafaedae-d0a6-456e-914f-488bd3cf2feb] Fetching instance by UUID {{(pid=127670) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:10:05.514451 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6e3697e0-f48e-44a2-930a-82e277040839 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:10:05.514451 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6e3697e0-f48e-44a2-930a-82e277040839 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:10:05.515297 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6e3697e0-f48e-44a2-930a-82e277040839 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:10:05.515297 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6e3697e0-f48e-44a2-930a-82e277040839 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:10:05.515297 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6e3697e0-f48e-44a2-930a-82e277040839 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:10:05.515297 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG oslo_concurrency.lockutils [None req-6e3697e0-f48e-44a2-930a-82e277040839 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:10:05.515613 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.wsgi [None req-6e3697e0-f48e-44a2-930a-82e277040839 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] HTTP exception thrown: Instance aafaedae-d0a6-456e-914f-488bd3cf2feb could not be found. Sep 16 10:10:05.516505 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-6e3697e0-f48e-44a2-930a-82e277040839 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Request method failure captured: Sep 16 10:10:05.516505 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: request: DELETE /compute/v2.1/servers/aafaedae-d0a6-456e-914f-488bd3cf2feb HTTP/1.1 Sep 16 10:10:05.516505 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept: application/json Sep 16 10:10:05.516505 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Accept-Encoding: identity Sep 16 10:10:05.516505 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Connection: close Sep 16 10:10:05.516505 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Length: 0 Sep 16 10:10:05.516505 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Content-Type: application/json Sep 16 10:10:05.516505 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Host: 10.222.0.73 Sep 16 10:10:05.516505 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: Openstack-System-Scope: None Sep 16 10:10:05.516505 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: User-Agent: python-urllib3/1.26.12 Sep 16 10:10:05.516505 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Auth-Token: gAAAAABjJEnidMURbkOXWkOoXCQEVVzN5JJJRyCzqXcYDKZKyLbXnP841EPT257VDd76wG1DoSO3rYQisE-0sb2M3u60F_V7CwM68TYlOJeG2UsQb0-IfVl8n6FZZzzz-XpPC42sn5mvSkfdEluuyoutWKLqeXFrg-kXh0Wd_2HNduxHYhKKEv8 Sep 16 10:10:05.516505 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Id: None Sep 16 10:10:05.516505 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Domain-Name: None Sep 16 10:10:05.516505 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Identity-Status: Confirmed Sep 16 10:10:05.516505 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Is-Admin-Project: True Sep 16 10:10:05.516505 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Id: default Sep 16 10:10:05.516505 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Domain-Name: Default Sep 16 10:10:05.516505 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Id: aaeb5ec036dd43479e9b66290a29d6d5 Sep 16 10:10:05.516505 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Project-Name: tempest-TestVolumeBootPattern-703768359 Sep 16 10:10:05.516505 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Role: reader,member Sep 16 10:10:05.516505 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Roles: reader,member Sep 16 10:10:05.518219 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/aaeb5ec036dd43479e9b66290a29d6d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_aaeb5ec036dd43479e9b66290a29d6d5", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/aaeb5ec036dd43479e9b66290a29d6d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/aaeb5ec036dd43479e9b66290a29d6d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 10:10:05.518219 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant: tempest-TestVolumeBootPattern-703768359 Sep 16 10:10:05.518219 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Id: aaeb5ec036dd43479e9b66290a29d6d5 Sep 16 10:10:05.518219 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-Tenant-Name: tempest-TestVolumeBootPattern-703768359 Sep 16 10:10:05.518219 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User: tempest-TestVolumeBootPattern-703768359-project Sep 16 10:10:05.518219 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Id: default Sep 16 10:10:05.518219 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Domain-Name: Default Sep 16 10:10:05.518219 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Id: f2747c55351847dbb66f29c992dd62aa Sep 16 10:10:05.518219 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: X-User-Name: tempest-TestVolumeBootPattern-703768359-project Sep 16 10:10:05.518219 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: method: > Sep 16 10:10:05.518219 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: exception: Instance aafaedae-d0a6-456e-914f-488bd3cf2feb could not be found. Sep 16 10:10:05.518219 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: action_args: {'id': 'aafaedae-d0a6-456e-914f-488bd3cf2feb'} Sep 16 10:10:05.519184 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 10:10:05.519184 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 10:10:05.519184 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 10:10:05.519184 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 10:10:05.519184 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 10:10:05.519184 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 10:10:05.519184 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 10:10:05.519184 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 10:10:05.519184 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 10:10:05.519184 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 10:10:05.519184 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aafaedae-d0a6-456e-914f-488bd3cf2feb could not be found. Sep 16 10:10:05.519184 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 10:10:05.519184 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 10:10:05.519184 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 10:10:05.519184 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 10:10:05.519184 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 10:10:05.519184 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 10:10:05.519184 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 10:10:05.519184 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 10:10:05.519184 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 10:10:05.520793 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 10:10:05.520793 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 10:10:05.520793 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 10:10:05.520793 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 10:10:05.520793 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 10:10:05.520793 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 10:10:05.520793 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 10:10:05.520793 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 10:10:05.520793 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 10:10:05.520793 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aafaedae-d0a6-456e-914f-488bd3cf2feb could not be found. Sep 16 10:10:05.520793 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 10:10:05.520793 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 10:10:05.520793 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 10:10:05.520793 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 10:10:05.520793 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 10:10:05.520793 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 10:10:05.520793 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 10:10:05.520793 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 10:10:05.520793 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aafaedae-d0a6-456e-914f-488bd3cf2feb could not be found. Sep 16 10:10:05.520793 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: ERROR nova.api.openstack.wsgi Sep 16 10:10:05.522255 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-6e3697e0-f48e-44a2-930a-82e277040839 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Returning 404 to user: Instance aafaedae-d0a6-456e-914f-488bd3cf2feb could not be found. {{(pid=127670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 10:10:05.522255 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-6e3697e0-f48e-44a2-930a-82e277040839 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "DELETE /compute/v2.1/servers/aafaedae-d0a6-456e-914f-488bd3cf2feb" status: 404 len: 111 microversion: 2.1 time: 0.034345 Sep 16 10:10:05.522255 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 627/1251] 10.222.0.73 () {58 vars in 1239 bytes} [Fri Sep 16 10:10:05 2022] DELETE /compute/v2.1/servers/aafaedae-d0a6-456e-914f-488bd3cf2feb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 10:10:05.527371 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-e2bd3f25-a34b-4283-9ff8-207e0897f06f tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '>' {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:10:05.527988 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.compute.api [None req-e2bd3f25-a34b-4283-9ff8-207e0897f06f tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] [instance: aafaedae-d0a6-456e-914f-488bd3cf2feb] Fetching instance by UUID {{(pid=127671) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 10:10:05.535160 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e2bd3f25-a34b-4283-9ff8-207e0897f06f tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:10:05.535647 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e2bd3f25-a34b-4283-9ff8-207e0897f06f tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:10:05.536089 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e2bd3f25-a34b-4283-9ff8-207e0897f06f tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:10:05.536790 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e2bd3f25-a34b-4283-9ff8-207e0897f06f tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Acquiring lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 10:10:05.537262 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e2bd3f25-a34b-4283-9ff8-207e0897f06f tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 10:10:05.537752 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG oslo_concurrency.lockutils [None req-e2bd3f25-a34b-4283-9ff8-207e0897f06f tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Lock "6dc1d2d4-28ba-4d76-b176-2388586d08d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 10:10:05.552225 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.wsgi [None req-e2bd3f25-a34b-4283-9ff8-207e0897f06f tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] HTTP exception thrown: Instance aafaedae-d0a6-456e-914f-488bd3cf2feb could not be found. Sep 16 10:10:05.553854 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-e2bd3f25-a34b-4283-9ff8-207e0897f06f tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Request method failure captured: Sep 16 10:10:05.553854 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: request: GET /compute/v2.1/servers/aafaedae-d0a6-456e-914f-488bd3cf2feb HTTP/1.1 Sep 16 10:10:05.553854 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept: application/json Sep 16 10:10:05.553854 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Accept-Encoding: identity Sep 16 10:10:05.553854 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Connection: close Sep 16 10:10:05.553854 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Length: 0 Sep 16 10:10:05.553854 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Content-Type: application/json Sep 16 10:10:05.553854 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Host: 10.222.0.73 Sep 16 10:10:05.553854 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: Openstack-System-Scope: None Sep 16 10:10:05.553854 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: User-Agent: python-urllib3/1.26.12 Sep 16 10:10:05.553854 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Auth-Token: gAAAAABjJEnidMURbkOXWkOoXCQEVVzN5JJJRyCzqXcYDKZKyLbXnP841EPT257VDd76wG1DoSO3rYQisE-0sb2M3u60F_V7CwM68TYlOJeG2UsQb0-IfVl8n6FZZzzz-XpPC42sn5mvSkfdEluuyoutWKLqeXFrg-kXh0Wd_2HNduxHYhKKEv8 Sep 16 10:10:05.553854 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Id: None Sep 16 10:10:05.553854 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Domain-Name: None Sep 16 10:10:05.553854 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Identity-Status: Confirmed Sep 16 10:10:05.553854 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Is-Admin-Project: True Sep 16 10:10:05.553854 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Id: default Sep 16 10:10:05.553854 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Domain-Name: Default Sep 16 10:10:05.553854 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Id: aaeb5ec036dd43479e9b66290a29d6d5 Sep 16 10:10:05.553854 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Project-Name: tempest-TestVolumeBootPattern-703768359 Sep 16 10:10:05.553854 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Role: reader,member Sep 16 10:10:05.553854 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Roles: reader,member Sep 16 10:10:05.555667 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/aaeb5ec036dd43479e9b66290a29d6d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_aaeb5ec036dd43479e9b66290a29d6d5", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/aaeb5ec036dd43479e9b66290a29d6d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/aaeb5ec036dd43479e9b66290a29d6d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Sep 16 10:10:05.555667 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant: tempest-TestVolumeBootPattern-703768359 Sep 16 10:10:05.555667 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Id: aaeb5ec036dd43479e9b66290a29d6d5 Sep 16 10:10:05.555667 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-Tenant-Name: tempest-TestVolumeBootPattern-703768359 Sep 16 10:10:05.555667 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User: tempest-TestVolumeBootPattern-703768359-project Sep 16 10:10:05.555667 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Id: default Sep 16 10:10:05.555667 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Domain-Name: Default Sep 16 10:10:05.555667 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Id: f2747c55351847dbb66f29c992dd62aa Sep 16 10:10:05.555667 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: X-User-Name: tempest-TestVolumeBootPattern-703768359-project Sep 16 10:10:05.555667 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: method: > Sep 16 10:10:05.555667 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: exception: Instance aafaedae-d0a6-456e-914f-488bd3cf2feb could not be found. Sep 16 10:10:05.555667 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: action_args: {'id': 'aafaedae-d0a6-456e-914f-488bd3cf2feb'} Sep 16 10:10:05.556650 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: {{(pid=127671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 10:10:05.556650 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 10:10:05.556650 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 10:10:05.556650 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 10:10:05.556650 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 10:10:05.556650 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 10:10:05.556650 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 10:10:05.556650 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 10:10:05.556650 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 10:10:05.556650 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 10:10:05.556650 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aafaedae-d0a6-456e-914f-488bd3cf2feb could not be found. Sep 16 10:10:05.556650 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 10:10:05.556650 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 10:10:05.556650 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 10:10:05.556650 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 10:10:05.556650 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 10:10:05.556650 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 10:10:05.556650 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 10:10:05.556650 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 10:10:05.556650 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 10:10:05.558395 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 10:10:05.558395 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 10:10:05.558395 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 10:10:05.558395 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 10:10:05.558395 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 10:10:05.558395 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 10:10:05.558395 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 10:10:05.558395 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aafaedae-d0a6-456e-914f-488bd3cf2feb could not be found. Sep 16 10:10:05.558395 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 10:10:05.558395 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 10:10:05.558395 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 10:10:05.558395 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 10:10:05.558395 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 10:10:05.558395 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 10:10:05.558395 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 10:10:05.558395 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 10:10:05.558395 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aafaedae-d0a6-456e-914f-488bd3cf2feb could not be found. Sep 16 10:10:05.558395 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: ERROR nova.api.openstack.wsgi Sep 16 10:10:05.559818 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: DEBUG nova.api.openstack.wsgi [None req-e2bd3f25-a34b-4283-9ff8-207e0897f06f tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Returning 404 to user: Instance aafaedae-d0a6-456e-914f-488bd3cf2feb could not be found. {{(pid=127671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 10:10:05.559818 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: INFO nova.api.openstack.requestlog [None req-e2bd3f25-a34b-4283-9ff8-207e0897f06f tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "GET /compute/v2.1/servers/aafaedae-d0a6-456e-914f-488bd3cf2feb" status: 404 len: 111 microversion: 2.1 time: 0.032314 Sep 16 10:10:05.559818 dv-cinder-790535-43-iscsi devstack@n-api.service[127671]: [pid: 127671|app: 0|req: 625/1252] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Sep 16 10:10:05 2022] GET /compute/v2.1/servers/aafaedae-d0a6-456e-914f-488bd3cf2feb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 10:10:07.109129 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: DEBUG nova.api.openstack.wsgi [None req-e5321435-2a01-40b6-a362-26e90a9b5290 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] Calling method '.version_select at 0x7ffa6dbc69d0>' {{(pid=127670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 10:10:07.226630 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: INFO nova.api.openstack.requestlog [None req-e5321435-2a01-40b6-a362-26e90a9b5290 tempest-TestVolumeBootPattern-703768359 tempest-TestVolumeBootPattern-703768359-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-415399696" status: 202 len: 0 microversion: 2.1 time: 0.122083 Sep 16 10:10:07.227217 dv-cinder-790535-43-iscsi devstack@n-api.service[127670]: [pid: 127670|app: 0|req: 628/1253] 10.222.0.73 () {58 vars in 1260 bytes} [Fri Sep 16 10:10:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-415399696 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)